rayforce: load from Parquet, benchmark release v2.11.0 - #2386
Merged
alexey-milovidov merged 3 commits intoOct 4, 2026
Merged
Conversation
|
|
ser-vasilich
had a problem deploying
to
benchmark-approval
October 4, 2026 15:12 — with 
GitHub Actions
Error
GitHub Actions
Error
./load now streams hits.parquet (download-hits-parquet-single) into the same splayed table with .parquet.splayed instead of parsing hits.csv. The type vector keeps the native schema; the file's integer EventDate (days) and EventTime / ClientEventTime / LocalEventTime (Unix seconds) are mapped with UNIX_DATE / UNIX_SECONDS to native DATE / TIMESTAMP. The resulting table and query results are the same as with the CSV load. Bumps the benchmarked-release note to v2.11.0 so the automation reruns the entry. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
ser-vasilich
force-pushed
the
rayforce-parquet-load
branch
from
October 4, 2026 15:15
f153aa3 to
e4e4e5b
Compare
ser-vasilich
had a problem deploying
to
benchmark-approval
October 4, 2026 15:15 — with
GitHub Actions
Error
GitHub Actions
Error
…al, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl)
Contributor
|
Results for Logs:
|
robot-clickhouse
had a problem deploying
to
benchmark-approval
October 4, 2026 19:45 — with
GitHub Actions
Error
GitHub Actions
Error
Contributor
|
Results for Logs:
|
robot-clickhouse
requested a deployment
to
benchmark-approval
October 4, 2026 21:02 — with
GitHub Actions
Waiting
GitHub Actions
Waiting
This branch is waiting to be deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Rayforce v2.11.0 was released today. Besides bumping the benchmarked-release note so the automation reruns the entry, this switches the load from
hits.csvtohits.parquet.Load.
benchmark.shdownloadshits.parquetwithdownload-hits-parquet-single, and./loadstreams it with.parquet.splayedinto the same splayed on-disk table as before. The type vector increate.rflkeeps the native schema; the file's integerEventDate(days) andEventTime/ClientEventTime/LocalEventTime(Unix seconds) are mapped withUNIX_DATE/UNIX_SECONDSto nativeDATE/TIMESTAMP. The data is converted on load and the queries run on the native table, as with the CSV load.Checked with the v2.11.0 release and these scripts on the same
hits.parquetthatdownload-hits-parquet-singlefetches: the load completes in a container limited to 30 GB of memory and 16 cores; the table has the same size as with the CSV load (59042332197 bytes), and all 43 queries return the same results as on the CSV-loaded table.