Google Launches BigQuery Studio, a New Way To Work With Data

An anonymous reader quotes a report from TechCrunch: Companies increasingly see the value in mining their data for deeper insights. According to a NewVantage survey, 97.6% of major worldwide organizations are focusing investments into big data and AI. But challenges stand in the way of executing big data analytics. One recent poll found that 65% of organizations feel they have "too much" data to analyze. Google's proposed solution is BigQuery Studio, a new service within BigQuery, its fully managed serverless data warehouse, that provides a single experience to edit programming languages including SQL, Python and Spark to run analytics and machine learning workloads at "petabyte scale." BigQuery Studio is available in preview as of this week.

"BigQuery Studio is a new experience that really puts people who are working on data on the one side and people working on AI on the other side in a common environment," Gerrit Kazmaier, VP and GM of data and analytics at Google, told TechCrunch in a phone interview. "It basically provides access to all of the services that those people need to work -- there's an element of simplification on the user experience side." BigQuery Studio is designed to enable users to discover, explore, analyze and predict data. Users can start in a programming notebook to validate and prep data, then open that notebook in other services, including Vertex AI, Google's managed machine learning platform, to continue their work with more specialized AI infrastructure and tooling.

With BigQuery Studio, teams can directly access data wherever they're working, Kazmaier says. And they have added controls for "enterprise-level" governance, regulation and compliance. "[BigQuery Studio shows] how data is being generated to how it's being processed and how it's being used in AI models, which sounds technical, but it's really important," he added. "You can push down code for machine learning models directly into BigQuery as infrastructure, and that means that you can evaluate it at scale."

Search engines were supposed to be this

[Hugedatabase]

Then Google decided only they were allowed to query the Internet.

It's a trap!

[narcc]

They'll keep this going just long enough for you to start to rely on the platform ... then they'll cancel the whole project [killedbygoogle.com].

Re: Always Canceling Apps [Re:It's a trap!]

[Tablizer]

Indeed! Instead of Yankee Doodle, it's Yankee Google.

Re:

[garcia]

I have been using GCP/BQ heavily for 7+ years now and we're GCP native at my current company for nearly 5 years.

Google's penchant for deprecating products is a constant worry for me, particularly our insane reliance on BQ. While BQ StandardSQL is close enough, lifting and shifting to something like AWS or Azure's cloud warehouse tooling would definitely be a headache.

That said, with their deep integration w/GA4 reporting and continued development of BQ, I am guessing they make enough money (particularly aft

Pick?

[Barny]

puts people who are working on data on the one side and people working on AI on the other side

Do we get to choose which side lives and which side dies? Please tell me we do.

p-hacking

[VeryFluffyBunny]

Ah great, p-hacking on a massive scale; streetlight effect, spurious correlations, random/meaningless patterns, etc., galore!

Anything but learning your discipline, developing expertise, & thinking hard, right?

Give It All to Google?

[LoudPipesSaveLives]

Google has always wanted to slurp up data for their own uses. This is just the golden opportunity they have been looking for. I won't be giving them my data warehouses anytime soon.

Data Farming

[groebke]

Look, companies volunteering data for our AI training...