News for hackers. Stuff that matters.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by viraptor on Tuesday May 24, 2016 @04:53AM (#11759875)
This is great. While I use only travis for build/testing at the moment, I really appreciate a real competition between GH / GL / BB. Users of all the platforms win because of this.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by SanDimasFootbal on Tuesday May 24, 2016 @07:40AM (#11760688)
BB offering free unlimited private repos and CI steps up the competition a for sure.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by johnnycarcin on Tuesday May 24, 2016 @11:40AM (#11762443)
Don't forget VSTS either: https://www.visualstudio.com/products/visual-studio-team-ser...

Coming from a non-microsoft background (github + jenkins + travisci) I have been pleasantly surprised. Full disclosure, I currently work at M$.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by Fuxy on Tuesday May 24, 2016 @12:53PM (#11763168)
This is pretty much identical to how Gitlab does it. I was hoping they would take it at least one step further not just copy it.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by wosos on Tuesday May 24, 2016 @12:58PM (#11763224)
What could have been made better?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by sytse on Tuesday May 24, 2016 @02:54PM (#11764470)
At GitLab we announced pipelines two days ago https://about.gitlab.com/2016/05/22/gitlab-8-8-released/

Some of the ideas we're working on to improve it further:

- deployment environments (acceptance, pre-prod, prod)

- manually confirming deployments for production

- review apps deployments of feature branches

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by BenjaminCoe on Tuesday May 24, 2016 @01:06PM (#11763316)
I wrote the npm/npm Enterprise integration for pipelines:

http://blog.npmjs.org/post/144855273708/announcing-npm-for-a...

I was really impressed; It's really slick having the source-control/collaboration and CI/CD so tightly integrated.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by saurabhnanda on Tuesday May 24, 2016 @07:29AM (#11760622)
Sorry if this sounds like a newbie questions, but can I use this to run my test suite every time someone pushes to a feature-branch and/or before anything is merged to master?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @07:35AM (#11760669)
Yes. You can run any test framework that runs inside a Docker container. And you can specify different "steps" for different branches (either by name or by globbing).
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by stannous on Tuesday May 24, 2016 @07:40AM (#11760689)
This page has a nice diagram and explains how to configure different pipelines for different branches: https://confluence.atlassian.com/bitbucket/configure-bitbuck...
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ngoldbaum on Tuesday May 24, 2016 @08:56AM (#11761134)
It's too bad this is git only for now. Is there any plan to add support for mercurial repositories?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by rajksarkar on Tuesday May 24, 2016 @09:50AM (#11761457)
For the beta, only Git repositories are supported. We have plans to support Mercurial in the future.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ngoldbaum on Tuesday May 24, 2016 @03:20PM (#11764697)
Great to hear. Looking forward to trying out Pipelines once hg support is ready.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by stephenr on Tuesday May 24, 2016 @09:46AM (#11761430)
Oh. Well shit. I signed up for the beta without realising this.

At this point, the only thing keeping me on BitBucket instead of GitLab is Mercurial support.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by brianwawok on Tuesday May 24, 2016 @11:03AM (#11762156)
Serious question... are you using HG because of history, or do people actively choose HG over Git for new projects still?

Have used both, they are so close, seems "odd" to go for the way less popular one, barring you have a really old HG repo and haven't bothered to switch.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ngoldbaum on Tuesday May 24, 2016 @03:10PM (#11764603)
I prefer mercurial over git and will choose it every time for new projects unless there's some other concern preventing that.

Mercurial has a number of features that git never implemented - in particular revsets. I also prefer the hg CLI over the git CLI. Mercurial has sane, concise online help, and a lot of work went into the design of the command-line to be consistent, composable, and made of pieces that do one thing and do it well.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by rjbwork on Tuesday May 24, 2016 @03:21PM (#11764703)
Seconding this sentiment. Far, far, prefer hg to git. TortoiseHg blows away the Git UI's as well, IMO. I always feel like i'm poking around in the dark on SourceTree.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by kasey_junk on Tuesday May 24, 2016 @12:03PM (#11762660)
I do, assuming its just for me. I still much prefer the hg cli over git.

But, I'll grant its not worth fighting over if I am working with collaborators who have a git preference.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by tachion on Tuesday May 24, 2016 @01:04PM (#11763294)
I really like to ask, if someone has Git preference, or is Git the only thing they know, enforcing VCS === Git point of view on everyone around...
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by brianwawok on Tuesday May 24, 2016 @02:48PM (#11764418)
Kasey, it is "origin/master" or "origin master"? Ha ha
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by jordigh on Tuesday May 24, 2016 @03:12PM (#11764620)
Yes, many of us choose hg. Its development is lively, it keeps innovating, it's pleasant to use. Vive la résistance!
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by lukebennett on Tuesday May 24, 2016 @06:01AM (#11760161)
Interesting, I wonder if they always planned to launch their beta today or whether it got expedited after Gitlab's announcements over the last couple of days.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by spittet on Tuesday May 24, 2016 @06:21AM (#11760234)
I can give some more context on our launch. Today is the start of AtlasCamp, our annual developer conference, in Barcelona. We planned the launch on that date a while ago because it's the best time for us to share this exciting news.

We've always been invested in the CI/CD market (Bamboo has been around a long time) and Pipelines was just making sense for us to do to help all Cloud teams to build great software.

Sten, Bitbucket Pipelines Product Manager

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by lukebennett on Tuesday May 24, 2016 @06:35AM (#11760297)
Didn't realise today was AtlasCamp, I can see why you would have chosen it for the news.

Congrats on the beta launch, the more competition there is, the better for everybody!

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by spittet on Tuesday May 24, 2016 @07:22AM (#11760579)
Thanks! It's an exciting time for us and we're just getting started.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by blackbirdster on Tuesday May 24, 2016 @06:07AM (#11760174)
What about Continuous Integration? Though I like the many options we now have to easily set-up some CI, a lot of entreprises still rely on old-fashioned on-premise CI. I can only wonder about the impact of depreciating Bamboo Cloud and what to use next.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @06:21AM (#11760233)
I'm one of the Developer Advocates at Atlassian with a focus on the CI/CD space.

For "old-fashioned on-premise" CI/CD, Bamboo Server is still a solid offering from Atlassian, with active development on new features and support for existing ones. Discontinuing Bamboo Cloud is more about being able to "right-size" our cloud offerings so Atlassian can offer a CI/CD service for a team's first microservice deployed into AWS Elastic Beanstalk, and that scales up without overhead to many services each with many instances in a more complex environment like AWS ECS. And not just for AWS but for Azure, Google, Heroku, or whatever your choice of cloud platform. I believe Bitbucket Pipelines will be that next generation solution, while Bamboo will continue to serve on-premise needs for many years to come.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by blackbirdster on Tuesday May 24, 2016 @07:53AM (#11760755)
Nice to see you answering tehre :)

With Bamboo Cloud you were able to set up a pretty convenient "intermediate" solution, with Bamboo Cloud + an agent on your servers. Will it still be possible with Pipelines?

Also I couldn't find the doc for aggregating tests results.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @08:05AM (#11760835)
Not so much. One of the things that I think makes Pipelines better suited for cloud is that it's agent-less. But that does mean there's no option to run an agent on-premise to bridge pipeline execution. Indeed, if you are accustomed to Bamboo, you are likely to find Bitbucket Pipelines rather minimalist. For example, there is currently no facility for aggregating test results.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by estefan on Tuesday May 24, 2016 @07:07AM (#11760485)
How does this compare to shippable? Specifically, does it build docker containers which can be pushed to a registry (e.g. google's) and then deployed using Kubernetes into google cloud?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by spittet on Tuesday May 24, 2016 @07:27AM (#11760612)
We don't support yet running Docker commands as part of the Pipeline [1] however it's something that we will be looking into in the future.

[1] https://confluence.atlassian.com/pages/viewpage.action?pageI...

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by stuff4ben on Tuesday May 24, 2016 @08:59AM (#11761162)
Curious if there's going to be an on-prem version of this? We run Bitbucket at my company and Jenkins Enterprise as well. How does Bitbucket Pipeline compare to Jenkins Pipeline (https://jenkins.io/solutions/pipeline/)?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by tarkasteve on Tuesday May 24, 2016 @09:08AM (#11761208)
(Disclaimer; I'm an Atlassian employee.)

Bamboo is still the recommended solution for on-premises installations. The requirements and practicalities of OP vs cloud CI are different enough that they warrent different approaches.

That said, Bamboo supports scaling builds using AWS, and has 1st-class support for Docker-based build/test setups. I gave a talk on this at Atlassian's Summit last year if this sounds useful: http://summit.atlassian.com/videos/build/docker-continuous-i...

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by blktiger on Tuesday May 24, 2016 @10:01AM (#11761546)
I really want a way to configure bamboo via a text configuration file though. We're using it now, but we have to copy the configuration from build job to build job and each job ends up subtly different over time. :( Plus I really want a way to say here are the steps to deploy to a server, now run those steps against these three servers. It would be even better if each server could potentially have it's own ssh key for deployments to prevent a hacker from using bamboo to access all the other servers.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by itomato on Tuesday May 24, 2016 @10:49AM (#11762039)
You're not alone: https://jira.atlassian.com/browse/BAM-1223

  Dear Atlassian: This request has now been open for 9 years and has 247 votes.
  
  9 years.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by stuff4ben on Tuesday May 24, 2016 @10:49AM (#11762035)
I think that's where Bitbucket Pipelines comes into play. Their YAML file is similar in concept to TravisCI and others. Jenkins Pipeline has a jenkinsfile which is also similar in concept but is based on Groovy. While there's a learning curve for that, I would argue it's definitely more powerful.

https://confluence.atlassian.com/bitbucket/configure-bitbuck...

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by blktiger on Tuesday May 31, 2016 @03:22PM (#11809343)
I'm not so sure about that, first off the pipelines feature doesn't exist on Bitbucket Server and Atlassian recommends you use Bamboo there. Secondly, that doesn't help with managing secure access to production servers with potentially sensitive data. You'd just be moving from storing all the passwords/ssh keys in bamboo to storing them all in your version control system.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by asdz on Tuesday May 24, 2016 @05:03AM (#11759933)
Am I the only one that can't see the post at Atlassian blogs?

It's saying 'Sorry, that post was not found.'

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by colinbartlett on Tuesday May 24, 2016 @08:36AM (#11761014)
The page takes 53 seconds to load for me. Initial shell loads quickly, but the content does not appear for almost a whole minute. (Chrome on OS X with all extensions off.)

This doesn't help improve my confident in Bitbucket, which is already pretty low based on past uptime: https://statusgator.com/services/bitbucket

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by lysp on Tuesday May 24, 2016 @05:25AM (#11760005)
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by tiffanyh on Tuesday May 24, 2016 @10:01AM (#11761551)
Based on the video, this appears to require Docker [1]

I can only with for support of FreeBSD/Jails.

[1] https://www.youtube.com/watch?time_continue=122&v=p5KgjeZB8W...

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by yalooze on Tuesday May 24, 2016 @02:34PM (#11764284)
I think they're saying they run the pipeline builds using docker containers. It's how they can build easily based on any branch. Ie. what they use behind-the-scenes, not what you need to be using. Although I'm somewhat doubting myself now...
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @03:48PM (#11764916)
That's correct. Bitbucket Pipelines uses Docker as an execution environment for builds. However, if the goal of your build is to produce a container, whether Docker or otherwise, Bitbucket Pipelines cannot do that at this time.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by FrancoisBosun on Tuesday May 24, 2016 @09:18AM (#11761270)
What about multi-language repositories? If I have Java + Ruby, how will Pipelines work?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by tarkasteve on Tuesday May 24, 2016 @09:26AM (#11761319)
It uses Docker to manage the installed dependencies, so you can build your own Docker image with whatever you need and then use that in the pipeline configuration: https://confluence.atlassian.com/bitbucket/use-docker-images...
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by FrancoisBosun on Tuesday May 24, 2016 @09:29AM (#11761330)
You mean I should build a Docker image with both Java and Ruby? The image would be much larger than intended in that case. In production, I would have two different Docker images.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @10:00AM (#11761540)
At this time, it is a limitation of the beta that Bitbucket Pipelines can only associate a single image with your build. Avoiding the complexity of chaining images helped us to ship more quickly. I expect this will change before GA. For now, you would have to effectively "merge" the Dockerfiles your self and publish the image so Bitbucket Pipelines can pull it.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by kylecordes on Tuesday May 24, 2016 @09:37AM (#11761377)
It is unfortunately common to ship Docker containers to production that contain the entire tooling suite to build the thing being deployed, and it sounds like that might be what is happening in your case?

If I understand right the thing you're expected to provide to run inside "pipelines" is a container in which your build can be performed; the output of that build might also be a Docker container, but hopefully there is not a requirement that it be the same container in which you are performing the build. Or you might be shipping something completely different, totally unrelated to Docker, as your build output that gets sent onward to production. Of course all of this is just a guess, it will become more clear as some of us start to enter the beta program.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by spittet on Tuesday May 24, 2016 @11:26AM (#11762316)
Kyle, this is correct. We use containers simply to create the environment in which we'll execute the script commands in isolation. You can start with a small container and install dependencies during the run or you can prepare a bigger container with the dependencies installed already.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by drinchev on Tuesday May 24, 2016 @05:39AM (#11760067)
Does the pricing of this feature disclosed? I couldn't find it.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by roganartu on Tuesday May 24, 2016 @05:56AM (#11760139)
Pipelines is free during beta [1]. The post-beta pricing has not been announced.

[1] https://confluence.atlassian.com/display/BITBUCKET/Bitbucket...

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by spittet on Tuesday May 24, 2016 @06:08AM (#11760186)
Hi,

I'm one of the Product Manager on Bitbucket Pipelines. The beta is indeed free, with a limitation on the number of minutes per user per month (starting at 300mins/user/month but that may change during the beta).

We haven't decided on the post-beta pricing yet. The beta will help us understand better how our customers are using it so that we can price it accordingly. We're leaning towards a model that scales well with the number of users on an account.

Let me know if that helps.

Thanks,

Sten Pittet

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by jcazevedo on Tuesday May 24, 2016 @02:29PM (#11764246)
Do you have some details on the kind of hardware Bitbucket Pipelines will run, as that can affect the time it takes to run a workflow? More specifically, how many cores and how much memory will the containers have access to?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by spittet on Saturday May 28, 2016 @07:17AM (#11791264)
We will be experimenting different configurations during the beta to find the right fit. Some details about the resources available are published in our documentation [1] and will be updated as we move forward.

[1] https://confluence.atlassian.com/pages/viewpage.action?pageI...

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by brento on Tuesday May 24, 2016 @04:31PM (#11765226)
I got beta access, created a custom docker image and got my tests to run however lots of them are failing because I need redis. Is there a way to add Redis server?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by rajksarkar on Tuesday May 24, 2016 @04:56PM (#11765400)
Currently not inside pipelines. You could create your own redis and connect to that. Best option is to stub/mock redis in the tests.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by chrisbroadfoot on Tuesday May 24, 2016 @05:59PM (#11765874)
Add Redis to your custom docker image?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by edwinksl on Tuesday May 24, 2016 @06:13PM (#11765956)
Will Pipelines remain free for Bitbucket Cloud users?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by rajksarkar on Tuesday May 24, 2016 @06:22PM (#11766005)
It's FREE during the beta. We will have more information to share about pricing closer to the general availability time.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by edwinksl on Tuesday May 24, 2016 @07:12PM (#11766338)
Well, here is to hoping it will remain free after the beta.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by shruubi on Tuesday May 24, 2016 @08:23AM (#11760949)
Yay, and once again us Google App Engine users are shafted from having good CD support, especially when we use Bitbucket as our repo host.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @08:51AM (#11761103)
While we don't have the "recipe" documented in an example repository, GAE does have right knobs and levers that would make it possible to use Bitbucket Pipelines with GAE. Give it a try! And, even if we haven't made an example repository yet, don't rule it out.
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by shruubi on Tuesday May 24, 2016 @08:58AM (#11761148)
I'd love to, I just have no idea where I would even start. Any advice?
Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @10:19AM (#11761692)
I've written some of the code for other deployment targets. One of my earliest was for S3: https://bitbucket.org/ian_buchanan/pipeline-example-aws-s3

So, the first thing to check is for simple REST APIs that you can curl. If I recall correctly, GAE is tricky because it takes more than 1 API call.

Next, check for a CLI or script library. I see Google provides an SDK that might work: https://cloud.google.com/appengine/downloads#Google_App_Engi...

In that case, we have to pull the library into an appropriate image. For example, here's how the Amazon folks solved for S3: https://bitbucket.org/awslabs/amazon-s3-bitbucket-pipelines-...

I won't have time to look at GAE more closely until next week, but hit me up on Twitter if you want to DM me: @devpartisan

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by chrisbroadfoot on Tuesday May 24, 2016 @06:01PM (#11765880)
My Travis config deploys to App Engine. Have a look at these two files:

https://github.com/GoogleCloudPlatform/golang-samples/blob/m...

https://github.com/GoogleCloudPlatform/golang-samples/blob/m...

Those might be useful for configuring Bitbucket Pipelines.

Re:Bitbucket Pipelines Beta: continuous delivery inside Bitb... by ibuchanan on Tuesday May 24, 2016 @10:29AM (#11761805)
My colleagues have pointed out the simple answer is: Anything you can do with Bash, you can do in Bitbucket Pipelines.