After attending DockerCon on 23rd June I took what people call Red Eye flight to reach Boston on 24th morning. I missed the Day 1 of Red Hat Summit on 23rd and had to miss keynotes 24th has as well because the flight got delayed. Later I have watched all those keystones. Apart from Jim Whitehurst and Paul Cormier keynote, I would recommend everyone to watch middle-ware keynote, specially the demo part in which we showed Red Hat Mobile platform and its integration with OpenShift v3. The demo is just too awesome.
At this summit Red Hat announced Red Hat Atomic Enterprise Platform to run containers at scale in production, OpenShift Enterprise v3 for Web scale distributed app and Red Hat Access Insight. All of these are very significant ones.
This summit was very special at personal front. Two years back when I first attended Red Hat Summit I got the signed copy of Gordon Haff’s Computing Next book and imagined that one day I would also do book signing like him. I never imagined that this would come true in just 2 years. Over the last year I wrote a book a Docker which got published on 11th June’15. On 24th June at Red Hat Summit we had a book signing event. It would be a memorable day of my life.
I attended few sessions on containers and OpenShift. I took part in expert bar and Performance BoF, in which we interacted with customers directly to discuss their performance related issues or any other general questions.
During my two day participation I met lot of co-workers/friends and had some good time over drinks, which is always a fun
I got the opportunity to attend DockerCon last month (June 22nn and 23rd’15) in San Francisco. This was my visit to SF. I reached there on 20th June’15. On 21st I took a bicycle on rent and cycled through Golden Gate Bridge, Sausalito and Tiburon. While coming back to SF I took Ferry from Tiburon. Later in the day I met Suman in person, Founder of RockStor Inc, whom I interacted few times virtually.
Next day on 22nd June, DockerCon started and one could feel lots on energy at the conference. Few important takeaways for me from the conferences are :-
- Docker wants to make internet programmable and it is becoming a tool for mass innovation
- Formation of Open Container project, under the auspices of the Linux Foundation, for creating open industry standards around container formats and runtime.
- runC, which is implementation of Open Container Project specifications
- Fast paced, bleeding edge Docker releases to experiment with upcoming features – Docker experimental
- Built-in multihost networking coming in next release, which would have plug-gable back-ends
- Docker plugins to extend the capabilities of Docker Engine. With Docker experimental release we can try Network and Volumes plugins today.
- Announcement of Docker Notary to securely publish and verify content. It is still work in progress.
Docker 1.7 was released with announcement of Docker Compose 1.3, Swarm 0.3 and Machine 0.3. Swarm now has Mesos integration and Machine can provistion different OS like RHEL, Fedora, Dabien, RancherOS
Following video from Docker team summarizes the DockerCon announcements
Other than talks I tried to catch-up with all the booths setup by different vendors/partners. I also spent some time Red Hat booth and distributed Container Coloring book by Dan Walsh.
I am happy to announce that my book on Docker, Docker Cookbook (dockercookbook.github.io) got published last week. I got introduced to the publisher through a tech friend of mine and I am thankful to him for sharing this opportunity with me. I started working on the book almost a year back.
I was very new to Docker at that time but was co-organizing Docker meetup in Bangalore, India and learning from Docker community. The book covers concepts, managing Docker and images, Network and Data management for containers, Docker use-cases, Orchestration and Hosting platforms, Docker Performance and Security. I tried to put whatever I learned in last year or so. There are many more topics in wish-list. Hopefully I get the chance to cover them in second edition.. :).
I would like thank all the reviewers of the book, Scott Collier, Allan Espinosa, Julien Duponchelle and Vishnu Gopal for giving their valuable time to review the content, giving suggestions and finding my mistakes.
It had been more work than expected. I spent many weekends, nights to work on it. There were few times when it felt that I won’t be able to pull it off but thankfully I did. I want to thank my family, friends and co-workers at office who supported me with this project. It was great fun to work on the book. During the process I learnt a lot and Docker community had been great help.
After successfully organizing the Docker Global hackthon on 1st Nov’14, we have not thought about the next meetup. Then Vishnu Kanan from Google pinged us saying that he would be visiting Banglaore during last week of Nov and would like to talk about Kubernetes. We had quick discussion among co-organizers and thought it would be great opportunity to learn about Kubernetes. So we fixed the date to 27th Nov’14 as per Vishnu’s convenience and Relevance Lab agreed to host it on a weekday. Other than Vishnu, a team from VMware presented on Integration of Kubernetes with VMware stack.
Though it was a weekday, ~35 people attended the meetup and almost everybody said that we should host it on Weekends.
At the start of meetup we had quick round of introduction and then Vishnu talked about Kubernetes.
After Vishu’s session, Vaibahv Kohli and his team members talked about Elasticity in Kubernetes. They also gave a demo in which they showed how a Minion is added dynamically in VSphere environment if existing minion run out of resources.
At the end of last session VMware team announced a new Bangalore meetup group for Kubernetes. It good but participants did not like the idea of having new meetup group just for Kubernetes. It can be part of existing Docker meetup. I mentioned that every time we do a Docker meetup, we always get people who are very new Docker so we have have to introductory session for 15 – 20 mins every-time. Kubernetes is pretty advance topic and if a person without Docker knowledge comes to meetup then he would not get anything. Anyways that was just suggestions from the earlier experience.
Project Atomic test day for Fedora 21 was scheduled on 20th Nov’14. To be a part of that we organized test day in Red Hat’s Bangalore office. As far as I know this is the first such activity we did in Fedora Community from Bangalore. In Pune, India Fedora community organised FADs on F21 testing and security in last few months.
We got really good response. Total 16 people were registered and from 11 turned up testing. Pretty good right :).
Some of the participants of this activity also attended CentOS Dojo, which CentOS community organized on 15th Nov’14. In that Aditya Patwari gave good overview of Project Atomic. That generated some interest in the project and made my job easier. Before starting the test day I gave quick overview of Docker, Atomic and how to use cloud init files. It took some time to get started but we all had the setup to test except one. After the overview we started running the test case created by Roshi. We recorded the test results at test-app . We also raised two bugs bz#1166073 and bz#1166082. By our end of day, when our US counter-parts came online, we had some good discussion as well.
We all had great time and hope everyone enjoyed and learned something new. We’ll look forward to more test days and Fedora activities from Bangalore and India.
~40 people attended Bangalore meetup. Before the hackathon we had following presentations :-
- Docker Global Hackday opening by Avi Cavale, Co-founder and CEO, Shippable.
- Introduction to Docker – Pranay Pareek, Shippable
- Introduction to Project Atomic – Neependra Khare, Red Hat.
In the last meetup we looked at CoreOS and decided to to look at Project Atomic in this meetup. I used Colin Walters slides to give Atomic presentations and then used Fedora 20 Atomic image to give Demo.
After the presentation and Lunch we had the hackathon. Four teams participated. I could not due to being host but I helped first timers with Docker handons. The four hacks we did are:-
1. Dockit – Docker GlusterFS integration @HumbleDevassy, @swordphilic, @hiSaifi
2. dockerComp – @arcolife,@krishnakalyan3 – Bangalore Hackathon Winner
3. Docker as a Load Balancer. @anandrm
Dockerize a Load Balancer to replace a Standalone Load Balancers.
4. CI with Docker @srikrishnaholla, @harishk8591106, @dilipkuki
We did not have anyone to judge, so we did the presentations and cast the vote ourselves. Local winner was dockerComp.
In Pune we did not hackathon but had great workshop. Look at the meetup page for awesome feedback. The workshop labs are available at following to anyone to use.
Overall it was a great experience. There were requests to do hands-on with Docker. We’ll try to do in next meetup.
Before joining Red Hat again two years back I was part of startup KQ Infotech (Which later got acquired by STEC Inc and now HGST). Before acquisition of KQ Infotech, we were extending the work from Lawrence Livermore National Laboratory (LLNL) of bring the Sun/Oracle ZFS file-system to Linux by porting POSIX layer. After the acquisition not much was done at that front. Anyways that is not what I want to discuss here.
Rockstor has come up with a NAS solution for Btrfs which is developed on top of Centos 7. I have been following it for year or so.The installation and manager is super easy. You can install it on VM, any commmodity hardware, Amazon. It provides some great feature like :-
– Fast Cloning
– Thin provisioning
– Dynamic volume management
– Replication over WAN
The other very interesting add-on which Rockstor provides is Smart Probes through which one can dig deeper to explore various aspect of storage infrasturure. It is based on SystemTap, so it would be very helpful to debug performance related problems.
It also has RESTful API to do automated provisioning and management, which would make it easy for integration with cloud storage.
As far as I know Rockstor is first to come-up with NAS solution on Btrfs. It is a very interesting project to watch.
1. Introduction to Docker- Jeeva, IBM
3. Intorduction to CoreOS – Jitendra Kumar Yadav, Verizon Labs
The meetup started with round of introduction from participants and the hosts. Jeeva gave short and good introduction to Docker. After that Madhurranjan gave excellent session on Namespaces and Cgroups. The demos really helped to understand concepts well. The last talk was from Jitendra of Verizon Labs in which he covered basics of CoreOS .
During the vote of thanks, Puneet talked about his experience from DockerCon, which he attended few month back. He also said he is very happy to see such active Docker community in Bangalore and Relevance Lab would be activly participating in the meetups.
We talked about two other things
1. Participating in the next global Docker hackathon which is scheduled last week October’14. I was happy to see many members showing interest to it. It would great if we can take participation to next level and contribute to Docker code base.
I participated in Sequoia Hack’14 with Shireeh Anjal. We worked in different teams at Red Hat. In last year’s Sequoia hack we participated in different teams. This years we decided to form a team and use the team name I used last time Shadowfax. As currently I am playing with Docker, so I wanted to do some hack around Docker.
Our project name was Social Listening with Docker Containers. Though our idea of the project did not change but we changed the pitch of the it. So we pitched it like following:-
Lets say you created a product and hired a PR to market in social media. The PR firms charges you with X amount of money saying that because of their marketing your product has generated N tweets/FB posts etc. You want to make sure that PR firms have done their job. In simple terms you want to a litmus test.
We were just able to do just with twitter in limited time. So you come to our app and either give your twitter credentials or just let us know what keyword you want to search.
After that we would start looking for that keyword and collecting tweets and save it. Once the observation time gets over we get analyse the tweets give the results. As of now we just generate the word cloud and give the location from it got tweeted,if it has been geo-tagged.
So where is Docker in it ? As soon as someone submits a request, we start a container with its environment variables set to ones passed by the user. Then we use those environment variables to call twitter APIs to collect tweets and save it to ElasticSearch. When we want to do the analysis we query the ElasticSearch and get the dataset and do the analysis.The front to our app is written in RoR and we used to python APIs to connect twitter.
It was great experience overall, learned few things saw some great hacks. Hope to participate in future hackathons and at-least reach in final N.
I got the opportunity to attend LinuxCon/CloudOpen NA this year, which happened last week b/w 20th to 22nd August’14.
Few take aways for me from the Keynote of Jim Zemlin were
– Software is eating the World and Open Source is eating the Software.
– Any software foundation should work like janitor for its project, enable structured investment, reach out to new industries
– Marketing is very important for opensource
There were many tracks to attend but I chose to attend mostly containers track, which contained most of the Docker, LXC talks. Within containers track and overall I liked James Bottomley talk on Containers in Linux: Current State and Where We’re Going . He covered the history of containerization and where it is headed. In very limited time he covered lots of ground.
Is It Safe To Run Applications In Linux Containers? This is talk which Jérôme Petazzoni gave. There is no simple Yes/No answer. Docker made it complicated. Engineers from different companies are work on this and answer should be Yes in near future.
In the Keynote Solomon Hykes shared most of the stuff from his DockerCon Keynode, which happened few months back. He talked about orchestration, networking, identity management.
Linda Wang gave good analogies to understand containization in general duing her talk Docker Enablement Makes Linux Container Easy to Deploy on Enterprise Linux and how Docker makes things easy for deployment.
I want to get involved more with Fedora, so I attended talk from Matthew Miller on How Linux Distros Became Boring (and Fedora’s Plan to Put Boring Where It Belongs). He shared usage trend of different Linux distributiions. He talked about Fedora Next and different types of Fedora variants community is planning to cater needs of different segments.
Joe Beda from Google talked about Kubernetes which is a Docker orchestration tool in his talk “Managed Containers, Open Source, and Google”. Rohit Jnagal and his teammate gave me quick demo on Kubernetes as well. From my dicucssions with fellow participants it is not clear how all the tools like Kubernetes, CoreOS, Atomic, Mesos, Openstack, Docker are going to fit together. It would be very interesting to watch this space in coming months and if possible to be part of it.
Joe ‘Zonker’ Brockmeier shared detailed about Red Hat’s Atomic project in his “Atomic in Depth: A Look at Project Atomic for Managing Docker Containers” talk. He also talked about Cockpit, rpm-ostree which project Atomic is going to use. This the project which I would like to contribute and make sure its production ready. I am going to play Fedora Cloud, which would have Atomic as basic building block. I hope we could do Fedora Activity Day (FAD) around it in India soon.
During the event I met many community members and had great discussions. Thanks a lot guys. Few social events were also orgnized during the main events. I went to Museum of Science and Industry, Chicago on first day of the main event and then on third day participated in Fun Run which was actually guided city tour.
I reached Chicago few days earlier and got the opportunity to explore the city as well. It is really a beautiful city and should sometime in future with Family. During my stay I also attended and presented at Chicago Docker meetup as well.
After the LinuxCon I spent next week in Red Hat’s Westford, MA office. It was great meeting with team face to face. With work we had lots of fun.