Fix Apache Timeout on Linux

My site sits on a Linux VPS running Apache 2.4 and what used to be instant page loads have turned into frequent timeouts. The first byte often takes ages, sometimes ending in a 504, yet once the connection finally starts static files stream normally... (Budget: $15 - $25 USD, Jobs: Apache, Database Management, HTTP, Linux, MySQL, Performance Tuning, PHP, System Administration)