人材紹介スキルハウス・スタッフィング･ソリューションズ株式会社/Skillhouse Staffing Solutions K.K.
IT関連（オープン・WEB系） - WebアプリケーションSE
IT関連（オープン・WEB系） - データベースSE
IT関連（オープン・WEB系） - プロジェクトマネージャー
A leading Fintech company is looking for a Data Engineer to work on their payment system to deliver the best payment experience for their customers.
The ideal candidate is a problem solver and a learner at heart. You should have a very high degree of comfort in a programming language of your choice. They offer a flexible work schedule and you get your choice of tools (both hardware and software) and most importantly, the opportunity to work on tough problems with the brightest minds around you.
・ Work directly with Data Analysts and Platform Engineering Team to create reusable experimental and production data pipelines
・ Understand, tune, and master the processing engines (like Spark, Hive, Cascading, etc) used day・to・day
・ Keep the data whole, safe, and flowing with expertise on high volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc)
|Growing fintech company provides QR code and bar code based payment system. The company offers a flexible work schedule and you get your choice of tools (both hardware and software) and most importantly, the opportunity to work on tough problems with the brightest minds around you.|
10:00 - 18:45（Mon - Fri）
Super Flextime available
・ Worked on building data pipelines ingesting and transforming large number of events per minute and terabytes of data per day
・ Worked with Spark and Kafka before and have experimented or heard about Flink/Druid/Ignite/Presto/Athena and understand when to use one over the other. Preferably, you have worked with cloud based big data processing platform such as AWS EMR, Google Cloud DataProc
・ Passionate about producing clean, maintainable and testable code part of real・time data pipeline
・ Understand how micro services work
・ Connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues
・ Understand issues with ingesting data from applications in multiple data centres across geographies, on・premise and cloud and will find a way to solve them
・ Proficient in Java/Scala/Python/Spark
|年収||日本・円 800万円 〜 1300万円|
|給与に関する説明||Social insurance, Transportation Fee, Defined contribution pension system, training programs, no smoking indoors allowed (Designated smoking area), etc.|
|休日||Saturday, Sunday, and National Holidays|