Fermionic Gaussian projected entangled pair states in 3+1 D: Rotations and relativistic limits

Fermionic Gaussian projected entangled pair states (PEPS) are fermionic tensor network state constructions that describe the physics of ground states of noninteracting fermionic Hamiltonians. As noninteracting states, one may study and analyze them very efficiently, in both analytical and numerical means. Recently it was shown that they may be used as the starting point - after applying so-called PEPS gauging mechanisms - for variational study of nontrivial, interacting states of lattice gauge theories. This is done using sign-problem free variational Monte Carlo techniques. In this work we show how to generalize such states from two to three spatial dimensions, focusing on spin representations and requirements of lattice rotations. We present constructions that are crucial for the application of the above-mentioned variational Monte Carlo techniques for studying nonperturbative lattice gauge theory physics, with fermionic matter, in 2+1D and 3+1D models. Thus, the constructions presented here are crucial for the study of nontrivial lattice gauge theories with fermionic tensor network states.