{"id":1340,"date":"2013-07-31T18:01:17","date_gmt":"2013-07-31T16:01:17","guid":{"rendered":"http:\/\/blog.gocept.com\/?p=1340"},"modified":"2013-07-31T18:01:17","modified_gmt":"2013-07-31T16:01:17","slug":"reproducable-automated-deployments-on-raspberrypi-with-batou","status":"publish","type":"post","link":"https:\/\/blog.gocept.com\/2013\/07\/31\/reproducable-automated-deployments-on-raspberrypi-with-batou\/","title":{"rendered":"Reproducable automated deployments on RaspberryPi with batou"},"content":{"rendered":"<p>For continuous integration during development, we use Jenkins to automatically run tests for all projects we maintain. Some time ago we wanted to increase visibility of the results, so we set up a <a href=\"http:\/\/raspberrypi.org\">Raspberry Pi<\/a> driving a few meters of <a href=\"https:\/\/www.adafruit.com\/products\/306\">LPD8806-based LED<\/a> strip on which we can address single LEDs to represent the status of individual or aggregated builds.<\/p>\n<h2>Automating deployments is a good idea&#8230;<\/h2>\n<p>After an SD Card failure we were painfully remembered how hard it can be to set up a service where all parts were deployed manually. Fortunately we wrote at least some minimal documentation on how to set everything up, so after a few days we were presented with many broken builds. Of course nobody cared about the build status with all LEDs being dark. \ud83d\ude41<\/p>\n<h2>Let&#8217;s automate!<\/h2>\n<p>Today we wondered if we can use our deployment-tool <a href=\"http:\/\/batou.readthedocs.org\">batou<\/a> to make reproduceable deployments to a raspberry pi, and did some tests on a vanilla raspbian image (2013-07-26 &#8220;Wheezy&#8221;).<\/p>\n<h2>Preparing your Raspberry Pi<\/h2>\n<p>Of course, you can not deploy to it without some simple preparations. First thing is, batou needs to be able to log on the target host with a public ssh key, so we copied our public key to the raspi which has the address 192.168.0.5 in this example:<\/p>\n<pre>\r\nlocal&gt; ssh-copy-id pi@192.168.0.5\r\npi@192.168.0.5's password:\r\nType password of user pi, default: \"raspberry\"<\/pre>\n<p>(If you don&#8217;t have the ssh-copy-id, you have to manually append your ssh public key to <code>\/home\/pi\/.ssh\/authorized_keys<\/code>, which you will need to create on a plain installation)<\/p>\n<h2>Manually install minimal requirements<\/h2>\n<p>Batou does also have a few requirements which are needed to bootstrap the environment:<\/p>\n<ul>\n<li>mercurial \u2013 to pull the buildout which sets up batou<\/li>\n<li>python-virtualenv \u2013 to create a clean python environment for the buildout<\/li>\n<li>python-dev \u2013 to compile libcrypto against<\/li>\n<\/ul>\n<p><em>Note: We are currently working on batou 1.0 which most likely will no longer need any of these.<\/em><\/p>\n<p>You can install all the requirements at once with the following command on your raspi:<\/p>\n<pre>\r\npi&gt; sudo aptitude install mercurial python-virtualenv python-dev<\/pre>\n<h2>Prepare batou<\/h2>\n<p>Now you are ready to do your first batou deployment to a raspberry pi. For our experiments we created a small hello-world batou deployment, containing a test component which deploys a file \/tmp\/test which contains &#8220;foo&#8221; to a raspberry pi specified by an IP address.<\/p>\n<p>To begin, clone the repository on your local machine:<\/p>\n<pre>local&gt; hg clone https:\/\/bitbucket.org\/gocept\/batou-on-raspberrypi\r\nlocal&gt; cd batou-on-raspberrypi<\/pre>\n<p>Now, edit <code>environments\/pi.cfg<\/code> and set the IP-address of your Raspi.<\/p>\n<p>To create the nessecary scripts to do the deployment, run buildout to create a sandbox containing all dependencies of batou and the scripts you can use to deploy:<\/p>\n<pre>local&gt; python bootstrap.py\r\n\u2026\r\nlocal&gt; bin\/buildout<\/pre>\n<h2>Deploy!<\/h2>\n<p>After some minutes, your batou deployment sandbox will be ready for use. You most likely modified <code>environments\/pi.cfg<\/code> so you need to check in that change first, because batou refuses to deploy a dirty working copy.<\/p>\n<pre>\r\nlocal&gt; hg ci -m 'change ip of my raspi'\r\n<\/pre>\n<p>To run the deployment, call batou-remote with the name of the environment (&#8220;pi&#8221;, which corresponds to <code>environments\/pi.cfg<\/code>). Because the ssh user you use to connect with the target host differs from your local user, you have to specify it with <code>--ssh-user<\/code>.<\/p>\n<pre>\r\nlocal&gt; bin\/batou-remote pi --ssh-user=pi\r\n<\/pre>\n<p>Batou will now set up itself on the remote side and deploys all components specified in <code>pi.cfg<\/code>. To show it worked, check if the deployed file contains the correct content:<\/p>\n<pre>pi&gt; cat \/tmp\/test\r\nfoo\r\n<\/pre>\n<h2>Further readings<\/h2>\n<p>To learn more about batou, check <a title=\"Batou documentation\" href=\"http:\/\/batou.readthedocs.org\">http:\/\/batou.readthedocs.org.<br \/>\n<\/a><br \/>\nIf you want deploy your real life mission critical python applications into a fully automated environment using batou, head over to the <a title=\"Flying Circus\" href=\"http:\/\/flyingcircus.io\">Flying Circus<\/a>.<\/p>\n<h2>TL;DR<\/h2>\n<ul>\n<li>Create reproducable automated deployments for your software is great fun.<\/li>\n<li>Preparing a raspi to be a target host for batou 0.2.12 based deployments is easy:\n<ul>\n<li>Install python-virtualenv, mercurial and python-dev.<\/li>\n<li>Put your ssh public key on the raspi.<\/li>\n<\/ul>\n<\/li>\n<li>Example deployment can be found on <a href=\"https:\/\/bitbucket.org\/gocept\/batou-on-raspberrypi\">bitbucket<\/a>.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>For continuous integration during development, we use Jenkins to automatically run tests for all projects we maintain. Some time ago we wanted to increase visibility of the results, so we set up a Raspberry Pi driving a few meters of LPD8806-based LED strip on which we can address single LEDs to represent the status of &hellip; <a href=\"https:\/\/blog.gocept.com\/2013\/07\/31\/reproducable-automated-deployments-on-raspberrypi-with-batou\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Reproducable automated deployments on RaspberryPi with batou&#8221;<\/span><\/a><\/p>\n","protected":false},"author":12391367,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[10221],"tags":[4121751,8915,832,49695267],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pFP3y-lC","jetpack-related-posts":[{"id":179,"url":"https:\/\/blog.gocept.com\/2012\/05\/28\/sprint-report-deploying-python-web-applications-platforms-and-applications\/","url_meta":{"origin":1340,"position":0},"title":"Sprint report: Deploying Python web applications &#8211; platforms and applications","author":"Daniel Havlik","date":"May 28, 2012","format":false,"excerpt":"Last week I met Stephan Diehl, Michael Hierweck, Veit Schiele, and Jens Vagelpohl\u00a0in Berlin for a sprint. Our chosen topic was \"Python web application\u00a0deployment\". In this post I'd like to recap our discussions, gocept's perspective on those, and the deployment tool \"batou\" that we have been incubating in the last\u2026","rel":"","context":"In &quot;en&quot;","block_context":{"text":"en","link":"https:\/\/blog.gocept.com\/category\/en\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1433,"url":"https:\/\/blog.gocept.com\/2014\/08\/04\/september-18th-20th-devops-sprint\/","url_meta":{"origin":1340,"position":1},"title":"September, 18th\u201320th: DevOps Sprint","author":"Daniel Havlik","date":"August 4, 2014","format":false,"excerpt":"Since we have a strong history in web development, but also were involved in operating web applications we developed, the DevOps movement hit our nerves.Under the brand name \"Flying Circus\" we are establishing a platform respecting the DevOps principles.A large portion of our day-to-day work is dedicated to DevOps related\u2026","rel":"","context":"In &quot;en&quot;","block_context":{"text":"en","link":"https:\/\/blog.gocept.com\/category\/en\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":230,"url":"https:\/\/blog.gocept.com\/2012\/09\/27\/autumn-developer-bbq\/","url_meta":{"origin":1340,"position":2},"title":"Autumn Developer BBQ","author":"","date":"September 27, 2012","format":false,"excerpt":"Our second meet\/talk\/barbecue event was last week, and we think it was even better than the first one. In the unconference part, these were the topics we talked about: Demo of batou, the deployment tool Django Sentry: centralized error-logging DRBD vs. NFS vs. Sheepdog Beautiful Javascript Thanks to everyone who\u2026","rel":"","context":"In &quot;en&quot;","block_context":{"text":"en","link":"https:\/\/blog.gocept.com\/category\/en\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":236,"url":"https:\/\/blog.gocept.com\/2012\/10\/24\/upcoming-talks-at-pycon-de-2012\/","url_meta":{"origin":1340,"position":3},"title":"Upcoming talks at PyCon DE 2012","author":"","date":"October 24, 2012","format":false,"excerpt":"Most of gocept is headed towards the German PyCon next week! We're excited and look forward to meeting people, exchanging ideas and learning new things. We have prepared several talks to share some of the experiences we gained over the last year: Christian Kauhaus: nagiosplugin library Christian Theune: batou deployment\u2026","rel":"","context":"In &quot;en&quot;","block_context":{"text":"en","link":"https:\/\/blog.gocept.com\/category\/en\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":209,"url":"https:\/\/blog.gocept.com\/2012\/08\/28\/gocept-developer-bbq-2\/","url_meta":{"origin":1340,"position":4},"title":"gocept-Developer-BBQ 2","author":"Daniel Havlik","date":"August 28, 2012","format":false,"excerpt":"Unser erstes BBQ (R\u00fcckblick BBQ 1) war inhaltlich und kulinarisch ein voller Erfolg, und soll nun am Freitag, 14. September ab 14 Uhr seine Fortsetzung finden. Also, alle (Web-)Entwickler und Sysadmins die wie wir gerne mal \u00fcber den Tellerrand schauen, sind herzlich eingeladen. In einem an Open Space angelehnten Format\u2026","rel":"","context":"In &quot;de&quot;","block_context":{"text":"de","link":"https:\/\/blog.gocept.com\/category\/de\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1437,"url":"https:\/\/blog.gocept.com\/2014\/07\/03\/follow-up-actions-after-the-filesystem-corruption-incident\/","url_meta":{"origin":1340,"position":5},"title":"Follow up actions after the filesystem corruption incident","author":"","date":"July 3, 2014","format":false,"excerpt":"On 2014-06-07, the Flying Circus experienced a quite unfortunate filesystem corruption\u00a0incident. Most of the VMs have been cleaned up since then, but a few defective files are still around. In the following article, I'll provide some background information on what types of corruption we saw, what you (as our customer)\u2026","rel":"","context":"In &quot;en&quot;","block_context":{"text":"en","link":"https:\/\/blog.gocept.com\/category\/en\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/posts\/1340"}],"collection":[{"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/users\/12391367"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/comments?post=1340"}],"version-history":[{"count":16,"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/posts\/1340\/revisions"}],"predecessor-version":[{"id":1356,"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/posts\/1340\/revisions\/1356"}],"wp:attachment":[{"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/media?parent=1340"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/categories?post=1340"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.gocept.com\/wp-json\/wp\/v2\/tags?post=1340"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}