Google Search Advocate Daniel Waisberg not too long ago introduced an in-depth video on bulk information exports, a function that permits you to export, retailer, and analyze Search Console information.
This novel resolution surpasses capabilities and makes managing monumental information volumes a breeze.
Right here’s how.
An Overview of Present Knowledge-Exporting Options
Earlier than introducing the majority information export function, Waisberg recapped the prevailing strategies to export Search Console information.
Probably the most accessible manner is thru the person interface. You possibly can straight export as much as 1,000 rows of information with a easy click on on the export button.
Looker Studio and the API present options for individuals requiring bigger information volumes. Each channels help you retrieve efficiency information, URL inspection information, sitemaps, and web site information, with an export restrict of as much as 50,000 rows.
Introducing Bulk Knowledge Export
The ultimate and most superior technique to export information from Search Console is bulk information export.
This distinctive function permits you to extract huge quantities of information through Google BigQuery with out row limits. That is helpful for giant web sites with quite a few pages or intensive visitors.
Waisberg states, “A bulk information export is a scheduled each day export of your Search Console efficiency information. It consists of all the info utilized by Search Console to generate efficiency experiences. Knowledge is exported to Google BigQuery, the place you possibly can run SQL queries for superior information evaluation and even export it to a different system.”
Setting Up Bulk Knowledge Export
Given its complexity and energy, Bulk Knowledge Export requires present data of the Google Cloud Platform, BigQuery, and Search Console.
Remember that leveraging this software would possibly incur prices, so it’s essential to contemplate the potential costs earlier than establishing a brand new export.
Organising a bulk information export includes Google Cloud and Search Console.
Step One: Google Cloud
First, change to the related venture in Google Cloud and make sure the BigQuery API is enabled.
- Open your Google Cloud Console and change to the venture you’re exporting information to.
- Navigate to APIs & Providers > Enabled APIs & Providers, and allow BigQuery API if it isn’t.
- Navigate to IAM and Admin, click on + GRANT ACCESS, and paste search-console-data-export@system.gserviceaccount.com in New Principals.
- Grant two roles to this account: BigQuery Job Consumer and BigQuery Knowledge Editor, then Save.
Step Two: Search Console
In Search Console, full the next steps:
- Navigate to Settings > Bulk information export.
- Enter your Google Cloud venture ID into the Cloud venture ID subject.
- Select a dataset identify. The default is ‘searchconsole’.
- Choose a location in your dataset. This may’t be simply modified later.
- Click on Proceed to start out the exports. The primary export will occur as much as 48 hours after profitable configuration.
- After desk creation, set a partition expiration if wanted however keep away from schema alterations.
- For historic information previous the preliminary setup, use Search Console API or experiences.
Monitoring & Managing Knowledge Exports
The brand new information export system has a built-in function that allows you to monitor information exports utilizing BigQuery. For instance, you possibly can monitor exports utilizing an export log desk.
Notice that information will accumulate indefinitely until you set an expiration time. The export course of will proceed till manually deactivated or if Search Console faces points.
In case of any errors, Search Console will notify all property house owners.
In Abstract
In conclusion, the majority information export function can improve the way you handle giant quantities of Search Console information.
Keep tuned for upcoming content material from Google that may delve deeper into processing information after establishing export and finest practices for extracting information from BigQuery.
Supply: YouTube
Featured picture generated by the creator utilizing Midjourney.
