Big Data Engineer


$80.75 to $93.50 per hour


San Francisco, CA

Date Posted:

June 6, 2019

Employment Type:


Job Reference:


Staffing Area:

Technology & IT

Duration: 6 months

Top Skills:
3 different projects
GCP project, split project into multiple

*First Project - 3-6 months
Google tech, ACL, GCS, BigQuery, networking knowledge, understand security
Work with different teams, comm skills need to be very good.
1-2 quarters long
Security side ? most data is in GCP, need to control who can access what. Need strict access control.
Up to 10 terabytes data, migrate data to different project ?
Need someone strong enough to execute
Migration project

More operational side, understand how data works, migrate tables, how to make networking well.
Team ? will work solo, but will communicate with different teams, talk with analyst and BI group, must be detailed oriented
Technical Skills:
Google cloud 3+ years of exp
GCS queries, BigQuery,

*Second project: 2-3 month projects (2.1)
Pipeline team, exp on containers, kubernetes, deploy to kubernetes, running major pipeline, scala based,
Containerized, deployed to gcp,
Want them to containerized the project
Deployment is not efficient right now.
Moving to kubernetes since it more scalable ? Kakfa not good,
Understand how docker works
Need to have done this before

Tech Skills
Kubernetes ? 2 years of exp
Java ? 3 years ? no code just understand, minimal change, not building anything out with java
Scala - - understand, read, some changes but not full code, change to containerized ? 2 years
GCP ? understand
All systems are scala except bigloader

*Third project: 2-3 month (2.2)
Issues with data pipeline, new features,
Scala developer
Google, bigquery, stackdriver, big table,
Docker and kubernetes experience
Google Cloud Platform
Technology doesn't change the world. People do.

As a technology staffing firm, we can't think of a more fitting mantra. We're extreme believers in technology and the incredible things it can do. But we know that behind every smart piece of software, every powerful processor, and every brilliant line of code is an even more brilliant person.

Leader among IT staffing agencies

The intersection of technology and people — it's where we live. Backed by more than 65 years of experience, Robert Half Technology is a leader among IT staffing agencies. Whether you'[re looking to hire experienced technology talent or find the best technology jobs, we are your IT expert to call.

We understand not only the art of matching people, but also the science of technology. We use a proprietary matching tool that helps our staffing professionals connect just the right person to just the right job. And our network of industry connections and strategic partners remains unmatched.

Apply for this job now or contact our branch office at 888-490-4429 to learn more about this position.

All applicants applying for U.S. job openings must be authorized to work in the United States. Robert Half will consider qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.

© 2019 Robert Half Technology. An Equal Opportunity Employer M/F/Disability/Veterans.

By clicking 'Apply Now' you are agreeing to Robert Half Terms of Use.

San Francisco, CA

50 California Street
10th Floor
San Francisco, CA 94111
Big Data Engineer
Salt Lake City, UT
Full Time
June 14, 2019
Big Data Software Engineer
Austin, TX
June 6, 2019
Big Data Engineer
Greenville, SC
Contract To Full Time
June 5, 2019
Sr. Big Data Engineer
San Francisco, CA
June 3, 2019
Big Data Engineer (Hadoop)
Temecula, CA
May 31, 2019
See More Jobs >

Availability Status

Let us know you're ready to work with one click.

Update My Status

Set Your Status

Click the blue button on your profile page at least once a week to keep your status set to Available.

Set Your Status

Your status will automatically change to Idle and Unknown over time, so update it weekly while you’re looking for work

Update My Status