BigQuery Export has been paused from YOUR-APP for exceeding export limits

BattleShip Park
2 min readMar 25, 2022
Photo by Joshua Hoehne on Unsplash

I have got a mail from Google.

Dear Google Analytics Admins and Property Editors,

The Google Analytics property YOUR-APP has exceeded daily BigQuery export limits and daily exports have been put on hold.

In order for BigQuery exports to resume, you will need to filter out events from your daily export so that volume falls below the export limits or upgrade the property to the 360 service level.

Best,

The Google Analytics Team

(I replace my app name with YOUR-APP)

Because I connected Google Analytics with BigQuery in Firebase several days ago.

I worried about the cost when I turned it on at that time. According to BigQuery documents, there are Analysis Pricing and Storage Pricing. I just wanted only to store without analysis and I turned on the switch without any burden for $0.02/GB=$20/TB.

I’ve never see a certain of export limitation for BigQuery when I investigated it before, but I found this document like below this time.

BigQuery Export limits

Standard properties have a daily BigQuery Export limit of 1 million events. If your property consistently exceeds the export limit, the daily BigQuery export will be paused and previous days’ exports will not be reprocessed.

Property editors and administrators will receive an email notification each time a property they manage exceeds the daily limit. That notification will indicate when their export will be paused if action is not taken. Additionally, if a standard property significantly exceeds the one-million-event daily limit, Analytics may pause daily exports immediately. If you receive a notification, please leverage the data stream and event filtering feature to decrease the volume of events exported each day and ensure the daily export continues to operate.

In summary,

  • BigQuery has a daily limit of 1 million events
  • Use the data stream and filtering

I went through the details in ‘BigQuery Links’ menu from GA and our service has events over 240M.

I can not filter those events because I need the every ones so my only option is the stream. the stream makes the extra pricing: $0.01/200MB = $0.05/GB = $50/TB. It looks small, but it is $1500/TB a month.

--

--

BattleShip Park

NaverZ에서 Sticker.ly를 개발하고 있습니다