Is It Illegal to Take Dirt from a Construction Site

Is It Illegal to Take Dirt from a Construction Site