Skip to content

update Alibaba Cloud Hologres result #626

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
+53 −49
Open

update Alibaba Cloud Hologres result #626

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion hologres/README.md
View file
Open in desktop
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After trying for almost 20 minutes, I managed to create a Alibaba Cloud account.

(Side note: I had to provide my mobile phone number to continue. I have about 30 online accounts in my password manager and not a single on of them needed my phone number.)

I then tried to create a Hologres account. The page asks me for a "Specification". I could not find anywhere whether I should choose "Compute-group type" or "General purpose". What specification did you use in this ClickBench submission? Please add to the README.md file.

Another question: "Zone J" and "Zone K" refer to geographical zones and there is no performance difference between them, right?

image

The page also asks about the number of "Gateway nodes" (--> next screenshot). Does that mean the number of "CU"s in the JSON result files in this PR or is it something different? Asking because the "CU" could also be the "Reserved Computing Resources of Virtual Warehouse" in the screenshot and it is ambiguous which values to choose for both.

The same page also asks about "Enabling Serverless computing" (--> next screenshot) and that this option is free. Should I turn this on, or keep it off? (please also document in the Readme.md)

image

I should specify a VPC and a "vSwitch" (<-- what does that mean?). There is a dialog to create them but I would appreciate an idiot-level guide to do so.

image

The bottom of the page presents a pricing proposal (next screenshot).

image

Not sure if that is a UI bug but it says 105 US-Dollar per CU (and for experimentation, I selected 2000 CUs). Does that mean if I click "Buy", that 2000 x 105 = ca. 210000 USD will be charged from my (private!) credit card?

Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ To evaluate the performance of Hologres, follow these guidelines to set up and e

3. **Sample Execution**:
```bash
./benchmark.sh ak sk host_name 80
./benchmark.sh ak sk host_name port
```
6 changes: 5 additions & 1 deletion hologres/benchmark.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -47,15 +47,19 @@ split -l 10000000 hits.tsv hits_part_

# load data
echo "Starting to load data..."
start_load_time=$(date +%s.%N)
for file in hits_part_*; do
echo -n "Load time: "
PGUSER=$PG_USER PGPASSWORD=$PG_PASSWORD command time -f '%e' psql -h $HOST_NAME -p $PORT -d $DATABASE -t -c "\\copy hits FROM '$file'"
done
end_load_time=$(date +%s.%N)
total_load_time=$(echo "$end_load_time - $start_load_time" | bc)
echo "Total load time: $total_load_time seconds"

# run clickbench test with queries
echo "Starting to run queries..."

./run.sh $PG_USER $PG_PASSWORD $HOST_NAME $PORT $DATABASE 2>&1 | tee log_queries_$DATABASE.txt

cat log_queries_$DATABASE.txt | grep -oP 'Time: \d+\.\d+ ms' | sed -r -e 's/Time: ([0-9]+\.[0-9]+) ms/\1/' |
awk '{ if (i % 3 == 0) { printf "[" }; printf $1 / 1000; if (i % 3 != 2) { printf "," } else { print "]," }; ++i; }' | tee result_queries_$DATABASE.txt
awk '{ if (i % 3 == 0) { printf "[" }; printf "%.3f", $1 / 1000; if (i % 3 != 2) { printf "," } else { print "]," }; ++i; }' | tee result_queries_$DATABASE.txt
90 changes: 45 additions & 45 deletions hologres/results/128core.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"system": "Hologres",
"date": "2025-05-21",
"system": "Alibaba Cloud Hologres",
"date": "2025-09-15",
"machine": "Hologres: 16 CU",
"cluster_size": 8,
"proprietary": "yes",
Expand All @@ -9,48 +9,48 @@
"load_time": 321,
"data_size": 19923251230,
"result": [
[0.200,0.065,0.018],
[0.091,0.021,0.018],
[0.113,0.021,0.020],
[0.093,0.020,0.025],
[0.136,0.068,0.066],
[0.286,0.131,0.126],
[0.090,0.018,0.018],
[0.096,0.020,0.019],
[0.166,0.144,0.081],
[0.220,0.103,0.095],
[0.143,0.036,0.031],
[0.143,0.036,0.038],
[0.258,0.117,0.109],
[0.330,0.178,0.157],
[0.408,0.122,0.151],
[0.168,0.055,0.057],
[0.429,0.331,0.334],
[0.278,0.243,0.228],
[0.979,0.748,0.788],
[0.077,0.015,0.022],
[0.305,0.026,0.020],
[0.364,0.025,0.024],
[0.579,0.026,0.027],
[0.876,0.048,0.049],
[0.273,0.116,0.046],
[0.184,0.117,0.122],
[0.198,0.049,0.069],
[0.410,0.030,0.028],
[1.926,0.875,0.802],
[0.318,0.235,0.227],
[0.247,0.066,0.070],
[0.372,0.108,0.111],
[0.749,0.588,0.634],
[1.150,0.862,0.851],
[1.292,0.948,0.950],
[1.640,1.528,1.583],
[0.182,0.039,0.030],
[0.105,0.028,0.035],
[0.085,0.033,0.027],
[0.114,0.096,0.044],
[0.094,0.029,0.028],
[0.101,0.030,0.096],
[0.082,0.025,0.026]
[0.152,0.041,0.018],
[0.094,0.028,0.026],
[0.077,0.017,0.017],
[0.061,0.017,0.016],
[0.089,0.032,0.032],
[0.173,0.078,0.071],
[0.074,0.016,0.013],
[0.047,0.017,0.013],
[0.112,0.047,0.045],
[0.115,0.054,0.048],
[0.076,0.022,0.020],
[0.086,0.025,0.023],
[0.138,0.064,0.060],
[0.150,0.087,0.100],
[0.148,0.077,0.072],
[0.095,0.034,0.032],
[0.217,0.189,0.184],
[0.161,0.134,0.145],
[0.508,0.400,0.404],
[0.051,0.008,0.005],
[0.165,0.018,0.020],
[0.142,0.018,0.015],
[0.213,0.024,0.024],
[0.445,0.077,0.081],
[0.065,0.019,0.018],
[0.084,0.030,0.029],
[0.055,0.022,0.017],
[0.171,0.022,0.017],
[0.808,0.430,0.428],
[0.083,0.029,0.026],
[0.155,0.039,0.039],
[0.191,0.062,0.056],
[0.502,0.361,0.403],
[0.562,0.419,0.412],
[0.627,0.419,0.429],
[0.115,0.034,0.031],
[0.060,0.020,0.018],
[0.062,0.019,0.016],
[0.051,0.022,0.017],
[0.062,0.027,0.025],
[0.049,0.019,0.017],
[0.056,0.019,0.018],
[0.052,0.017,0.016]
]
}
2 changes: 1 addition & 1 deletion hologres/results/32core.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"system": "Hologres",
"system": "Alibaba Cloud Hologres",
"date": "2025-05-21",
"machine": "Hologres: 16 CU",
"cluster_size": 2,
Expand Down
2 changes: 1 addition & 1 deletion hologres/results/64core.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"system": "Hologres",
"system": "Alibaba Cloud Hologres",
"date": "2025-05-21",
"machine": "Hologres: 16 CU",
"cluster_size": 4,
Expand Down