The action of sitting down can represent quitting or giving up.
Being in a seated position can represent watching or "sitting it out" rather than participating.