Skip to content

Conversation

jiahuizz
Copy link

@jiahuizz jiahuizz commented Sep 16, 2025

Like the previous submission, deployment outside Alibaba Cloud is not supported. Performance verification therefore requires access to a Hologres instance on Alibaba Cloud. We apologize for this limitation. The testing methodology is documented in README.md, and we are happy to provide vouchers to assist with validation.
We are submitting updated results in this version due to the release of a new system iteration that includes several optimizations.

@TimothyDing
Copy link

@rschu1ze Could you help us to review it?

@rschu1ze

This comment was marked as off-topic.

@jiahuizz
Copy link
Author

Sorry for the confusion — I think there might have been a misunderstanding. This is actually a submission for ClickBench, and the JSONBench submissions are in a different repository. Would it be convenient for you to take a look at this ClickBench submission first?

@wangmj17
Copy link

Sorry for the delay, I got a bit sidetracked.

This PR represents the first non-on-premise aka. the first cloud entry for JSONBench. Looking at the current dashboard, all entries run on the same hardware (i.e. there is no hardware dimension in the selector on top). This is different from the ClickBench dashboard which has a "machine" selector. So we either add a machine selector (I can do that) or another toggle "on-premise" vs. "cloud" to make clear that not all systems run on equally sized hardware.

Hi, thank you for the reply! I am the committer for JSONBench result of Hologres. We think it is better to add a toggle "on-premise" vs. "cloud". If you think "machine selector" is better, it is also ok with us.

@jiahuizz
Copy link
Author

Would you be available to review this PR when you get a moment? Thanks so much in advance! @rschu1ze

@alexey-milovidov
Copy link
Member

alexey-milovidov commented Oct 4, 2025

I confirmed with @rschu1ze that he will review this PR as soon as possible.

PS. This is a PR to ClickBench, not JSONBench.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After trying for almost 20 minutes, I managed to create a Alibaba Cloud account.

(Side note: I had to provide my mobile phone number to continue. I have about 30 online accounts in my password manager and not a single on of them needed my phone number.)

I then tried to create a Hologres account. The page asks me for a "Specification". I could not find anywhere whether I should choose "Compute-group type" or "General purpose". What specification did you use in this ClickBench submission? Please add to the README.md file.

Another question: "Zone J" and "Zone K" refer to geographical zones and there is no performance difference between them, right?

image

The page also asks about the number of "Gateway nodes" (--> next screenshot). Does that mean the number of "CU"s in the JSON result files in this PR or is it something different? Asking because the "CU" could also be the "Reserved Computing Resources of Virtual Warehouse" in the screenshot and it is ambiguous which values to choose for both.

The same page also asks about "Enabling Serverless computing" (--> next screenshot) and that this option is free. Should I turn this on, or keep it off? (please also document in the Readme.md)

image

I should specify a VPC and a "vSwitch" (<-- what does that mean?). There is a dialog to create them but I would appreciate an idiot-level guide to do so.

image

The bottom of the page presents a pricing proposal (next screenshot).

image

Not sure if that is a UI bug but it says 105 US-Dollar per CU (and for experimentation, I selected 2000 CUs). Does that mean if I click "Buy", that 2000 x 105 = ca. 210000 USD will be charged from my (private!) credit card?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants