Biomembranes are exceptionally crowded with proteins with typical protein-to-lipid ratios being around 1∶50−1∶100. Protein crowding has a decisive role in lateral membrane dynamics as shown by recent experimental and computational studies that have reported anomalous lateral diffusion of phospholipids and membrane proteins in crowded lipid membranes. Based on extensive simulations and stochastic modeling of the simulated trajectories, we here investigate in detail how increasing crowding by membrane proteins reshapes the stochastic characteristics of the anomalous lateral diffusion in lipid membranes. We observe that correlated Gaussian processes of the fractional Langevin equation type, identified as the stochastic mechanism behind lipid motion in noncrowded bilayer, no longer adequately describe the lipid and protein motion in crowded but otherwise identical membranes. It turns out that protein crowding gives rise to a multifractal, non-Gaussian, and spatiotemporally heterogeneous anomalous lateral diffusion on time scales from nanoseconds to, at least, tens of microseconds. Our investigation strongly suggests that the macromolecular complexity and spatiotemporal membrane heterogeneity in cellular membranes play critical roles in determining the stochastic nature of the lateral diffusion and, consequently, the associated dynamic phenomena within membranes. Clarifying the exact stochastic mechanism for various kinds of biological membranes is an important step towards a quantitative understanding of numerous intramembrane dynamic phenomena.