+1 vote
asked by (700 points)

Hi Miles,

I was trying to run DMRG on clusters, but the code got killed after a couple of sweeps (with max bond dimension already reached), not finishing the number of sweeps set. What I would assume was that if one particular sweep with max bond dimension could run successfully without memory issue, then the rest of the sweeps should be able to run without any memory issue, because they are supposed to be almost identical processes.

Maybe I'm wrong, but I would appreciate if you could some insight about this.

Thanks a lot,

1 Answer

0 votes
answered by (70.1k points)
selected by
Best answer

Hi Mason,
Thanks for the question: I've run into a similar behavior before, and I believe it's to do with something fundamental about DMRG. I think what's going on is that for first sweep where the max bond dimension is the largest one you set, or the one you are hoping will continue to fit in memory for subsequent sweeps, actually many of the MPS link or bond indices have not yet reached their maximum value. So even though they are allowed to reach this value, they actually haven't yet. Relatedly, tensors such as the "projections" of the Hamiltonian into pieces of the MPS have indices which are not yet as large as they could be.

Then, in the next sweep, finally all indices start to reach their maximum values and this is when you run out of memory.

Does that sound plausible? At any rate, the key point is that you are running out of memory somewhere even if it's not where you were initially expecting. So then the main thing you can do is to start having DMRG store tensors to disk before that point.

Best regards,

commented by (700 points)
yes, that makes a lot of sense to me. Thank you Miles!
Welcome to ITensor Support Q&A, where you can ask questions and receive answers from other members of the community.

Formatting Tips:
  • To format code, indent by four spaces
  • To format inline LaTeX, surround it by @@ on both sides
  • To format LaTeX on its own line, surround it by $$ above and below
  • For LaTeX, it may be necessary to backslash-escape underscore characters to obtain proper formatting. So for example writing \sum\_i to represent a sum over i.
If you cannot register due to firewall issues (e.g. you cannot see the capcha box) please email Miles Stoudenmire to ask for an account.

To report ITensor bugs, please use the issue tracker.