AWS Solutions Architect with Data Engineering

AWS Solution Architect with AWS Data Engineering experience

  • AWS Tools: AWS S3, Athena, Glue ETL, Lambda, API Gateway, Code Star, CloudWatch, Step Functions, Simple Notification Service, Cloud9, Kinesis, Cloud Trail, Audit Manager, Security Hub Code Commit, Code Build, Code Pipeline, Code Deploy, Cloud Shell, EFS, DMS, EC2
  • Tools/Technologies: Python, PySpark, Scala, Java, SQL, PostgreSQL

Basic Qualifications

  1. Experience with ETL, Data Modeling, and Data Architecture in AWS Cloud Platform.
  2. Expert-level skills in writing and optimizing SQL.
  3. Experience building Data Lake/Lakehouse Data Platforms using AWS Serverless architecture
  4. Experience with Big Data technologies such as Hadoop/Hive/Spark.
  5. Solid Linux skills.
  6. Experience operating very large data warehouses or data lakes.
  7. Minimum of 5 years of experience working in technical data analysis, data science, or data warehousing, with proven business analysis experience
  8. Strong understanding of Entity-Relationship models
  9. Experience working with large data sets, data preparation and data formats (structured, unstructured, semi-structured)
  10. Hands-on experience with programming languages, such as SQL, PL/SQL, Python, PySpark and Databases such as Oracle, PostgreSQL

Preferred Qualifications

  1. Hands on experience in AWS Cloud services to ingest Structured, unstructured, and semi-structured data – Data Ingestion from SFTP, API, Streaming sources, Database etc, using Glue ETL.
  2. Experience implementing Data Lake using S3 buckets, Glue, SNS, SQS, SES, Lambda, Batch, Step Function, Athena, Data Catalog, Data Brew, Sagemaker, Elastic Views, Kinesis, etc.
  3. Experience configuring ETL pipeline using AWS Lake Formation with Governed Tables.
  4. Implement platform MVP and conduct POC using AWS cloud services, document the findings in the Enterprise Architecture Portal.
  5. Experience developing ingestion patterns – Streaming APIs, RESTFull services, ETL/ELT, Files (Parquet, JSON, AVRO) using Python, Pyspark (Serverless Architecture)
  6. Experience developing Data standardization, Data Validation framework using Python, Pyspark, UDF, DataBrew.
  7. Sound knowledge of Data Lake architecture, Traditional Data Warehouse, Data Mart and Lakehouse architecture.
  8. Data modeling experience – Relational, dimensional and NoSQL (JSON) for data aggregation and Data Analytics.
  9. E xperience in any of the leading Visualization tools – Qlik Sense- preferred, Tableau, Power BI
  10. Experience in developing RESTFull Data services using Lambda, AWS API Gateway
  11. AWS Certified Data Analytics – Specialty Certification preferred.
  12. Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
  13. Experience with building data pipelines and applications to stream and process datasets at low latencies.
  14. Show efficiency in handling data – tracking data lineage, ensuring data quality, and improving discoverability of data.
  15. Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.

Additional Preferred Experience

  1. Knowledge of Engineering and Operational Excellence using standard methodologies.
  2. Elicit business and systems/data requirements from business users and subject matter experts
  3. Lead the development of common standards and tools for documenting requirements, rules and data specifications
  4. Manage and design the reporting environment, including data sources, security, and metadata
  5. Map functional and business requirements to data specifications
  6. Perform gap analysis for current and future state requirements and/or data specifications/interfaces

Life at Capgemini Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Flexible work
  • Healthcare including dental, vision, mental health, and well-being programs
  • Financial well-being programs such as 401(k) and Employee Share Ownership Plan
  • Paid time off and paid holidays
  • Paid parental leave
  • Family building benefits like adoption assistance, surrogacy, and cryopreservation
  • Social well-being benefits like subsidized back-up child/elder care and tutoring
  • Mentoring, coaching and learning programs
  • Employee Resource Groups
  • Disaster Relief

About Capgemini
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 360,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group reported in 2022 global revenues of €22 billion.

Get The Future You Want | www.capgemini.com
Disclaimer
Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is $105,600-$224,910.

This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical/dental/vision insurance, 401(k), and any other benefits to eligible employees.

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company’s sole discretion unless and until paid and may be modified at the Company’s sole discretion, consistent with the law.

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.

Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law

Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.

Job Category
Project Management
Job Type
Full Time/Permanent
Salary
USD 105,600.00 - 224,910.00 per year
Country
United States
City
New York
Career Level
unspecified
Company
Capgemini
JOB SOURCE
https://capgemini.taleo.net/careersection/1/jobdetail.ftl?job=072465&tz=GMT%2B02%3A00