Skip to content

Understanding the performance implications of using multiple GPUs (zkVM newbie) #2369

Description

@ceyhunalp

Component

sp1-zkvm

Describe the feature you would like

I have recently started exploring the zkVM ecosystem and my main focus has been experimenting with RSP to better understand the performance of SP1. If I understand correctly, the out-of-box proving software does not use multiple GPUs on a single machine, which means it is not possible to quantify the performance improvement in proving due to GPU parallelization without setting up a cluster.

I was wondering if Succinct has any numbers on the parallelizability trade-off? Basically, what is the marginal benefit of increasing the number of discrete GPUs in the cluster, i.e., how much speed-up does SP1 get from doubling/tripling/quadrupling/etc. the number of GPUs in the cluster? I am assuming there will be some communication and coordination overhead due to adding more GPUs to the cluster. I am also wondering if there are any unparallelizable portions of the proving process that would not benefit from the additional GPUs. If you have any measurements, even if they are rough estimates, I would love to hear them.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions