Data Lake Consulting for Financial Services Firm
Please find under a summary covering project details and feedback. The innate facts are kept as they are, private information is amended.
Introductory information
A fast induction on the buyer’s organisation
I’m the CIO at a long/brief equity hedge fund. I handle all of the software dev and data analytics.
Desired goal
What challenge were you trying to address with Caserta?
We’d built a strong transmitted hedge fund software platform and wanted to get implicated in big data and choice data analysis. We didn’t want to use a transmitted relational database, we wanted a cloud-based access but didn’t have the in-house expertise to create it ourselves.
Provided solution
What particular tasks were responsible for?
We talked to Caserta almost our goals, and they did a week-long dive into our data lake. We went through possible use cases, and they helped design and constructor the data lake, using AWS. We also debateed using different processing layers and scheduling orchestration tools, giving us a wide platform blueprint. We considered using a pre-made data lake platform, but they weren’t pliant sufficient, and Caserta came up with an excellent delineation.
Once we agreed on a proposed blueprint, Caserta granted a few consultants to work with our in-house team to create the infrastructure and write the code. They helped train our team members to get them up to despatch on our project. After that, we began to engender our leading set of analyses for our portfolio handlers.
As we worked on the project, Caserta suggested we use Databricks as our Spark layer to process the larger datasets. We wanted to be able to layer, so they recommended ductile computing to easily control the bunch of Spark machines. We also use AWS Redshift, and our processing engenders parquet files that are stored on Amazon S3. We use MicroStrategy to handle our inner components, and Caserta uses Tableau for interactive visuals that the analysts and portfolio handlers want. They also recommended Airflow as our orchestration server for the cloud.
Was there a dedicated team?
They prepare two expert resources in Python and data analytics and fetch in different experts, depending on the phase of the project. We also interact with Joe (Founder, Caserta).
How did you come to work with Caserta?
Joe was the keynote speaker at a debateion a while back, and he had a big access to handling choice data. He knew how to access larger datasets and create data lakes, so we got in touch and eventually hired them.
What are you approach expents (if diclosed)?
We’ve spent about $700,000.
What is the terminal result of working with ?
We partnered in November 2017, and the work is ongoing.
Results achieved
Are there any measureable or plum results?
We programned on only working unitedly for six months, but the project went so well and we had so much work coming in that we’ve extended the union. Our investment analysts are lucky with the work, and the platform has changed how our investment team processes and analyzes data. This has now befit a competitive space, and Caserta helped us get to market much faster than if we’d done this by ourselves.
How did Caserta accomplish from a project handlement standpoint?
A few of the consultants work on website with our team, so we haven’t had any issues interacting with them. We have a weekly call with Joe and customary check-ins. We meet in individual see few months to debate trends, progress, and any issues. They’re always affable, and I’m lucky with our relationship.
What is (from your point of view) the key factor to pay observation while intercourse with ?
Lots of nation apprehend big data tools, but Caserta has the power to both constructor and execute an powerful solution. Not see team can do both tasks well. They came up with a big program and efficiently executed it, edifice a functional and powerful fruit.
What aspects of their work would you like to get improved?
They should widen their areas of expertise. Right now, AWS is their strongest experienceset, but they should centre on other platforms, like Google Cloud.
Do you have any advice for forthcoming clients of theirs?
Have well-degoodd goals and know what your objectives are. Caserta’s a big team, you just need to point them in the right course.