Discover your future at Citi

Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Overview

ICG - Global Markets: High Performance Architectures - Infrastructure

The Principal Infrastructure Engineer, Electronic Trading is a senior-level position responsible for Systems Architecture aligned to low latency electronic trading infrastructure technologies. The overall objective of this role is to act as global Glue / Bespoke Technologies Subject Matter Expert (SME) for electronic trading infrastructure architecture.

Responsibilities:

• Conduct work on a variety of high-impact, high-profile problems/projects driving technology infrastructure aligned to the business.

• Identify and resolve issues, engaging in Root Cause Analysis (RCA) if escalation.

• Conduct responsibilities such as quality control, work allocation, coaching/mentoring, ensuring ongoing compliance with regulatory requirements.

• Evaluate controls to help mitigate negative outcomes through prevention, detection, and correction.

• Design and create complex processes and reporting streams, participate in the review and approval of requirement documents.

• Examine and update processes and procedures for hardware acquisition toward automation.

• Understand diverse stakeholder needs and share and influence stakeholder expectations.

• Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 6+ years of experience

• Experience in delivering infrastructure technologies products and services.

• Experience in financial services or large complex and/or global environment preferred.

• Experience developing projects for the identification of best practices (design of metrics, analytical tools, benchmarking activities and related reporting) Consistently demonstrate clear and concise written and verbal communication with ability to communicate technical concepts to a non-technical audience.

• Proven analytical, diagnostic, and multitasking skills with focus on execution and attention to detail.

• Demonstrated ability to both work independently and partner with virtual teams in a high-pressure matrix environment.

• Demonstrated ability to take ownership of various parts of a project/initiative with tight deadlines or unexpected changes in expectation/ requirements.

Education:

• Bachelor's degree/University degree or equivalent experience

• Master's degree preferred

About the Position

We are looking for an industry wide Senior Subject Matter Expert (SME) – Infrastructure who can provide leadership and direction for Change-The-Bank (CTB) electronic trading infrastructure initiatives covering all technologies (in this specific domain) for bespoke versions of technology aligned to electronic trading.

The role sits within Citi’s Global Markets: High Performance Architectures – Infrastructure (HPAi) group. This team is responsible for all electronic trading infrastructure architecture across all markets globally for the firm. It is composed of low latency Subject Matter Experts (North America, EMEA), Systems Architects (both regional and asset class aligned) and an aligned initiative management function (e.g. Technical Project Manager). Technology is key to our business; this role will require you to drive innovation and technology adoption in a large multi-faceted and complex environment. This ICG-Tech “Subject Matter Expert” resource will collaborate with ICG-Markets “the business”, CTI “Enterprise Infrastructure”, and CISO “Security” teams driving technical architecture and engineering of CTB and End of Vendor Support (EoVS) initiatives where we choose to innovate.

Reporting to the head of HPAi, the bespoke tech SME will be responsible for ensuring best in breed Linux and surrounding technology architecture and engineering in alignment with business requirements. This will be done in collaboration with CISO and CTI Compute resources aligned to HPAi who represent Enterprise and CISO priorities and standards. Active collaboration with all parties is required to be successful. The resource should be an industry thought leader, and able to not only steer the direction of Compute technologies for electronic trading but also roll their sleeves up and work as an individual contributor. The resource will leverage the full strength of the supporting non-ICG technology organizations (dedicated and non-dedicated to HPAi). The role is very broad requiring a resource that is not afraid to do new things and be challenged on a regular basis.

Low Latency Trading –Markets, domain specific technology is required in (solid knowledge for as many of the following as possible with focus on Monitoring, Messaging, Load Balancers, Security and related technologies:

The Technologies:

• Compute (Linux, CoreOS, Tuning, kernel bypass technologies, core dump analysis)

• Network (R&S, cut-through, Multicast, SDN, BGP, L1-L3, PCAP analysis)

• HPC File Systems (Lustre, GPFS, Weka, DDN, Ceph)

• Interconnects (InfiniBand, Slingshot, PCIe, NVLink, UALink, UPI, RoCE)

• HW (Server, FPGA, GPU, Memory, Cache, over clocking, cooling, ASIC, Quantum, NUMA)

• DevOps (OpenShift, Kubernetes, DevOps, Prog[Python, Perl, Shell], CI/CD)

• Programming (C, C++, Java, Rust, VHDL, Verilog)

• Time Sync (PTP, NTP, GPS, White Rabbit, SyncE)

• Wave (RF, Millimeter, Microwave, DWDM, Photonics)

• Storage (I/O, NAS, SAN, Object Store, SDS)

• Database (relational, columnar, graph, NoSQL, architecture, tuning)

• Monitoring (SPANs, TAPS, OEO, Packet Brokers, Corvil, SNMP, FIX, Logs, ELK, Open Telemetry, Grafana, Promethius)

• Messaging (TibRV, Solace, Aeron, ZeroMQ, Kafka, Multicast, Market data (TCP/UDP), Tibco, Exegy/Vela)

• Load Balancers (HW, SW)

• Security (Firewalls, PKI, TLS, IDS, Optical Encryption, AD, LDAP)

• Connectivity (WAN, Lucera, cross-connects, ECX, venue, client)

• Colo / Datacenter (Power, Space, Cage, Rack, Cabinet, Design)

The Skills:

• Deep knowledge of operating system fundamentals – hyper focus on Linux (REL, CoreOS)

• Understanding of OSI model and TCP and UDP network protocols

• Experience with Python and data libraries

• Fluency with the Unix command line and shell scripting

• Practical experience with modern Linux systems and systems programming concepts like C, IPC mechanisms, virtual memory, and process life cycle

• Strong troubleshooting skills and knowledge of profiling/debugging tools such as gdb, perf, DTrace, SystemTap

• Can understand, interpret, and improve application performance via system tuning

• Thorough understanding of modern computer architecture - modern x86 AMD and Intel cache hierarchies as an example.

• Kernel-bypass technology knowledge (such as Solarflare OpenOnload / TCPDirect / ef_vi, RoCE, DPDK)

• Prior experience in a similar Site Reliability Engineering (SRE), DevOps, distributed computing, systems engineering/administration

• Ability to context switch to work on several projects at once

• Knowledge of JIRA, SCRUM, Sprints

Details:

• Ingress/plan/execute/manage technical initiatives to make our electronic trading systems faster, more adaptable stable and maintainable aligned to HPAi standards.

• Communicate ideas, requirements, and results across disparate teams.

• This position will support technical populations (Rates), partnering with leaders to understand their challenges and design and execute solutions to solve them.

• Communicating business and IT requirements to external vendors and internal technical teams

• To succeed in this role, you must enjoy working independently and collaborating, being a hands-on contributor, learning on the fly and embrace change – rapid pace.

• You must be able to understand full-stack electronic trading technologies and engage effectively in a very technical manner with other SMEs, systems architects, the business (at times), Markets-Tech, and enterprise infrastructure organizations (CTI/CISO).

The Profile:

• Ability to efficiently analyze and deconstruct technical problems

• Excellent judgment with attention to detail and accuracy

• Strategic thinker who can understand and anticipate needs at all levels

• You enjoy tinkering with technology in your spare time

• Ability to manage time efficiently

• Can work independently and as a team player

• Passionate about making processes simpler and more effective, and constantly strive to make the people around them better

• Strong ability to build relationships as a trusted partner, and experience coaching more junior technical resources

• You are resourceful, have a sense of urgency, and are motivated to make things better and to always be learning. You don’t only want to just get the job done; you always want to deliver the highest quality work.

• Strong written and verbal communication skills with strong attention to detail

• Able to comprehend the major fundamentals of any project to understand how your role fits into the bigger picture

• Reliable, courteous, and a flexible team player

• Describes detailed problems with brevity and accuracy

• Can work autonomously with strong organizational skills

• Handles competing priorities in a challenging, fast-paced environment

• Fluency in English required

Here are the key skills and experience you should possess for this role:

• Extensive experience in designing and delivering infrastructure technology products, preferably within financial services or a large, complex global environment.

• Deep expertise in Linux operating systems and high-performance computing concepts, including kernel-level tuning and modern computer architecture (e.g., x86 cache hierarchies).

• Strong understanding of networking fundamentals(OSI model, TCP/UDP, multicast, SDN) and experience with network analysis tools (e.g., PCAP).

• Proficiency in various programming and scripting languagessuch as Python, C, C++, and shell scripting, with practical experience in systems programming and debugging.

• Proven ability to troubleshoot complex technical issues, analyze performance bottlenecks, and implement solutions in a high-pressure, fast-paced environment.

Job Family Group:

Technology

Job Family:

Infrastructure

Time Type:

Full time

Primary Location Full Time Salary Range:

$120,800.00 - $170,800.00

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi*.*

View Citi’s EEO Policy Statement and the Know Your Rights poster.