24bg inference problem

OutOfResources: out of resource: shared memory, Required: 114688, Hardware limit: 101376. Reducing block sizes or `num_stages` may help.


I get this error with my 3090, tried updating triton etc. didn't get to work.

Seems like these num values don't expect us to use a lower vram card?

Tried the flash reference inferece code.