Google BigQuery is a petabyte-scale serverless cloud data warehouse that enables scalable machine learning using SQL. In this talk, we take a look at how enabling data analysts and other SQL users to perform machine learning tasks can accelerate business decision-making and intelligence. We also present challenges in democratizing ML in large scale data warehouses such as BigQuery. We describe how a combination of general purpose SQL query engine and dedicated machine learning infrastructure can create a robust infrastructure for performing machine learning tasks.