The Big Data Engineer (BDE) is responsible for building the next generation of web applications and systems focusing on capability delivery to end users. The BDE is a member of a “big data” team of specialists within the multidisciplinary Agile development team.
Roles & Responsibilities
Manages requirements collection, software design, development and delivery – full lifecycle – in support of analysts.
Helps manage effective processes associated with the architecture.
Collaborates closely with the ASDs, TTDs, and the end user analysts to write and implement cutting edge big data algorithms and analytics.
Engages in software solution planning and creation to ensure capabilities are delivered using the latest available technologies and methods.
Operates in a “RAD/JAD” environment in which tasks are rapidly defined and then executed to ensure maximum user input, feedback and adoption.
Ensures the interoperability of the in-house capability with outside partners.
Active Security Clearance: TS/SCI
COMPTIA Security+ certification or CISSP certification
Proficiency in two or more of the following programming languages: C#, Java, .NET, Python, Perl, Ruby, or similar
Familiarity with current Agile methods
Proficiency with the following:
Multiple operating systems including: UNIX, Linux, Windows, Cisco IOS, etc.
Machine learning, data mining, and knowledge discovery
Analytic algorithm design and implementation
ETL processes; including document parsing techniques
Networking, compute, and storage technologies
Using or designing RESTful APIs, SOAP, XML
Developing large cloud software projects, preferably in Java, Python or C++ language
Java/J2EE, multithreaded and concurrency systems
Multi-threaded, big data, distributive cloud architectures and frameworks including Hadoop, MapReduce, Cloudera, Hive, Spark, Elasticsearch, etc. for the purposes of conducting analytic algorithm design and implementation
NoSQL database such as Neo4J, Titan, Mongo, Cassandra, and hBase
AWS Services (EC2, Network, ELB, S3/EBS, etc.)
Processing and managing large data sets (multi PB scale)
Web services environment and technologies such as XML, KML, SOAP, and JSON
Proficiency in trouble-shooting in very complex distributed environments including following stack traces back to code and identifying a root cause
Education: Bachelor’s of Arts or Bachelor’s of Science in Computer Science or related fields (e.g. Statistics, Mathematics, Engineering)
About Spatial Networks
Our mission at Spatial Networks is to acquire data and build cutting-edge technology to provide unique geospatial intelligence products that enable our customers to solve their most difficult problems. This requires combining talented people, effective methodologies, a focused mission and vision. A creative, collaborative culture means we agree and disagree, complement and critique, teach and learn but most importantly, do. Spatial Networks provides an energetic, fast-paced and fun environment that allows each team member the opportunity for great career and financial success.