DevOpsGirls started a year ago with a bunch of enthusiastic REA people who wanted to make a difference in diversity in Tech, particularly with women who are interested in DevOps.
After running two highly engaging bootcamps we have been discussing a lot about what’s next for this initiative. REA has been an amazing incubator of the idea and has provided everything that we needed so far to kick-start the movement, but among the organisers we had a feeling that if we wanted to reach the next level we needed bigger support from other individuals and organisations. That’s difficult to do if it’s attached to a single sponsor. With the great response we have had from the industry and the beautiful experience of having external coaches joining the previous boot camp has help us determine the next step.
And so — I am super happy to announce that DevOpsGirls will become part of DevOps Australia – an organisation well know for running conferences like DevOps Down Under! Thanks to Matt Jones for the support and we really believe this is a step in the right direction and would help DevOpsGirls operate in a more effective way.
At REA we happily use a variety of programming languages. Teams are given the freedom to choose a fitting language for a given project. Mostly this ends up being one of Ruby, Java, or Scala. However, there are some languages that we as developers and ops people get excited about, but the viability as a mainstream REA language hasn't yet been established.
For me personally, Haskell is what I code on the weekends and I've been looking for a way to shoehorn it into my regular work 😉
Recently I learnt that REA does in fact have some Haskell in prod. Who owns it? What does it do? No one will ever know. However as the story goes, it was automating a manual task and as such it was simply a value add that became a useful tool, and avoided questions like 'just what is a monad anyway!?'.
Jim Gaylard and I, Haskell acolytes, attempted something similar on hack day.
Only 6 months has passed since our inaugural DevOps Girls bootcamp and on Saturday 12th of August 2017 we had the pleasure of running the second edition. For those new to the bootcamp: it is a free event for women interested in learning more about devops, run by a community of passionate volunteers.
The idea started with a realisation that unless we are proactive about diversity in tech and we make meaningful contributions, it’s going to be hard to move the needle on this. The aim of the event is not only to train women but also to create a community of like-minded people who can provide support to each other.
Our first bootcamp went extremely well. From the moment it finished all the organisers and collaborators, apart from being exhausted, were already thinking: when are we doing this again? And of course, we did. We decided to run another introduction to AWS, iterating on the lessons that we learned in the first edition. Continue reading
Here in Consumer Insights we have been operating Big Data processing jobs using Apache Spark for more than 2 years. Spark empowers our daily batch jobs which extract insights from consumer behaviors from tens of millions of users who visit our sites. This blog covers our usage of Spark and aims to provide some useful insights for optimizing Spark applications based on our experience.
Recently we launched a recommendation engine, which was built using AWS Serverless technology. The journey of implementing this solution turned out to be an interesting one on a number of levels. Since its deployment into production, we thought it would be a good idea to share some of our lessons.
Essentially the system transforms a very large dataset into smaller ones that are used to create audiences or data segments which are used for hyper targeted EDMs.
To get from the initial state to the final state, the data is transformed over several stages using 8 Lambdas. Continue reading