Perhaps it's just avoiding the need to encapsulate an InfiniBand transport packet? I'm not sure how much overhead that introduces in RDMA, but DMTCP may just be an effort to divorce the idea from its original IB underpinnings.