News for hackers. Stuff that matters.

jayjohnson

Ask HN: How to crowdfund open source algorithmic trading platform and datasets

Hello all,I was tired of chasing down datasets to test investing ideas, so I built https://github.com/AlgoTraders/stock-analysis-engine and was wondering how + if a kickstarter or patreon (or something else) is worth the time to try to get traction? I'm currently running this all from my house, and I would like these funds to pay for hosting fees on AWS S3 so anyone can get started quickly...

( Read More... | 2 comments | 2 points | on HN )
Re:Riot Games Approach to Anti-Cheat on Tuesday July 17, 2018 @05:59PM (#17553834)
Good timing, I am using my own AI (keras + tensorflow) stack to predict in-game hackers on ARK Survival Evolved with an AWS EC2 instance. Here's some background on the fully open-sourced stack: https://github.com/jay-johnson/train-ai-with-django-swagger-... with docs http://antinex.readthedocs.io/ I would love some players, but I'm still load testing how many players the game server can use + make real time predictions without impacting the game. Reach out if you want to try it out!

Ask HN: Feedback setting up an IoT malware test bed for an AI dataset

I'm trying to teach AI how to defend against network exploits over ssh and telnet and make it all free open source. I wanted to know if anyone on here has any insights that I might be missing with the initial proposal to: use a test bed for recording a distributed malware simulation to generate some initial training datasets.For background, I am hoping to reuse all of the v1 webapp process...

( Read More... | no comments | on HN )
Not the same as HubPress (which looks like something I wish I knew about), but just a month ago I wanted to run an SSG locally (that wasn't using jekyll) so I built this one for deploying nginx + sphinx using docker. It auto-converts rst markup files into bootstrap + bootswatch html-themed posts (and has a search engine in it). http://jaypjohnson.com/2016-06-25-host-a-technical-blog-with...
Re:A Docker Container Pattern – Compose Configuration on Wednesday April 13, 2016 @02:08AM (#11486100)
These are great points, but with the post I wanted to share how I approach designing and building docker containers, because I hope it saves others time building them. When I started trying to deploy containers on production without Docker Compose it was painful. Now that I know what that time sink feels like, I try to focus on using configuration management during initialization inside the container instead of at the Dockerfile RUN directive (which requires a rebuild).

Back to your points, can I ask if you are interested in using this container approach to build a database container cluster in docker and then benchmark against a working imgadm(1M) + SmartOS environment? From the docker-side when I scale out a cluster of database runtime-only containers, I utilize the volume mounting attribute that is commented out in the repo's compose file (https://github.com/jay-johnson/docker-schema-prototyping-wit...) and then host the database files outside of the containers in a persistent storage location that is mounted + available on the hosts where the docker containers are running. As for building the database container for this proposed solution I would still utilize this Docker Compose-centric approach in development and then in production because I can build the container one time and not deal with a rebuild which invalidates testing a container within my DevOps artifact pipeline.

Wrapping up, I live more on the application development side so I cannot speak specifically to SmartOS or imgadm(1M), but I know the docker documentation and community are pretty helpful for getting/finding technical solutions that helped me build + launch products (go team!). If you are interested we can discuss more details about how I would approach bench marking these two database environments. I am a big proponent of testing everything and I would enjoy discussing how to tackle a db perf/load/ha + test harness like my message simulator (https://github.com/GetLevvel/message-simulator).

Feel free to connect with me on LinkedIn anytime: https://www.linkedin.com/in/jay-johnson-27a68b8a

Re:A Docker Container Pattern – Compose Configuration on Wednesday April 13, 2016 @12:16AM (#11485707)
Agreed. That's a great point when it is a simple use case, and how I started. Now that I build for Docker Compose out of the gate, it allows me to deploy a composition across a multi-host Docker Swarm (usually just changing the network driver to overlay + utilize labels) with 1 command, and more importantly I do not have to rebuild my container on production. Back in docker 1.9, I found myself running too many variations to get the same behavior that Compose natively handles with the new labels + overlay functionality (reference http://blog.levvel.io/blog-post/running-distributed-docker-s...). I was using `docker run` to deploy across specific hosts using manually-assigned env vars invoked with a docker run:

# docker run -itd --name=AppDeployedToNode1 --env="constraint:node==swarm1.internallevvel.com" busybox

# docker run -itd --name=AppDeployedToNode2 --env="constraint:node==swarm2.internallevvel.com" busybox

# docker run -itd --name=AppDeployedToNode3 --env="constraint:node==swarm3.internallevvel.com" busybox

RabbitMQ Example - https://gist.github.com/jay-johnson/2673ce4df42317667908#fil...

Looking back I feel like it was a lot of effort to deploy 3 busybox instances or that initial RabbitMQ cluster…and that effort to handle the “production deployment case” as early as possible is what set me on the path to the new Docker Compose-centric approach discussed in the link above.

Re:A Docker Container Pattern – Compose Configuration on Tuesday April 12, 2016 @11:52PM (#11485609)
So if I take a sample out of your Matsuri repo, how does this get changed as an "Overridables": https://github.com/shopappsio/matsuri/blob/f966480380b685d34...
Re:A Docker Container Pattern – Compose Configuration on Tuesday April 12, 2016 @11:45PM (#11485576)
I am pretty new kubernetes. What are some of the gaps with docker compose vs kube's deployment orchestration? I am pretty happy with docker 1.10.3, but am always interested in hearing about something better/cleaner (I don't know what I don't know). I'm looking over your github for some samples at the moment.
Re:A Docker Container Pattern – Compose Configuration on Tuesday April 12, 2016 @11:32PM (#11485516)
Agreed. It is not a good idea to store the db user/password in a docker-compose.yml file, but it is nice for demonstrating with a container that's more than a "hello world" + non-production use cases.
Re:A Docker Container Pattern – Compose Configuration on Tuesday April 12, 2016 @11:25PM (#11485483)
I totally agree and this is not a great idea for new comers. I do find it easier to debug things with all the bells and whistles turned on, but yea the CAP adds are NOT production ready. I will remove them to prevent confusion for those looking to get started with docker.
Re:On asking job candidates to code on Wednesday March 16, 2016 @01:08AM (#11295169)
Nice. I had the same experience with DO last September...The same month Braintree asked me to write a ruby project that took about 3 days and then on the call only asked about python sqlalchemy database queries. I don't know what the disconnect is with these larger companies and their HR staff? By the time that third one asked me to write a node.js rest api from scratch. I just chuckled and said thanks for your time...I doubt I will commit more than a few hours in the future to any throwaway project for just a call back. Why can't we get paid for the time spent writing sample code like a freelancer...If it isn't good enough pay for my time (up to a max) and both parties can move on. Time is more valuable than the risk of getting passed that initial callback/more screens.

Another failed startup's lessons in the B2C space

I am in the process of ending my startup (B2C investment technology) because it failed to find customers and or have a good product market fit (pick your poison). I thought I would share my lessons and musings for those that are interested.https://gist.github.com/jay-johnson/d902351f49294b6685bfHope someone finds value in these opinions.Good luck!

( Read More... | no comments | on HN )

Ask HN: New Product Rollout Advice and Strategies

I am looking to launch a new product website, but I do not have extensive experience with how to grow a customer base from scratch.Phase 1 - Rollout and Launch: During this initial growth phase, I know I need to continually improve how each customer type finds my product, and I need to make sure that my product is tracking "enough data" for generating some reports that I can...

( Read More... | no comments | on HN )

Ask HN: New Product Rollout Advice and Strategies

I am looking to launch a new product website, but I do not have extensive experience with how to grow a customer base from scratch.Phase 1 - Rollout and Launch: During this initial growth phase, I know I need to continually improve how each customer type finds my product, and I need to make sure that my product is tracking "enough data" for generating some reports that I can...

( Read More... | no comments | 2 points | on HN )

Older »