|Google brings together BigQuery and Kaggle in new integration |
Google bought Kaggle in 2017 to provide a data science community for its big data processing tools on Google Cloud. Today, the company announced a new direct integration between Kaggle and BigQuery, Google’s cloud data warehouse.
More specifically, data scientists can build a model in a Kaggle Jupyter Notebook, known as Kaggle Kernels in the community. You can then link directly to BigQuery through the tool’s API, making it much simpler to query against the data in the data warehouse using SQL, a language data scientists tend to be very familiar with.
The benefit of this approach, according to Google, is that you don’t have to actually move or download the data to query it or perform machine learning on it. “Once your Google Cloud account is linked to a Kernels notebook or script, you can compose queries directly in the notebook using the BigQuery API Client library, run it against BigQuery, and do almost any kind of analysis from there with the data,” Google wrote in a blog post introducing the integration.