News for hackers. Stuff that matters.

imnotreallynew

Isn’t the legality of web scraping still..disputed?

There’s been a few projects I’ve wanted to work on involving scraping, but the idea that the entire thing could be shut down with legal threats seems to make some of the ideas infeasible.

It’s strange that OpenAI has created a ~$80B company (or whatever it is) using data gathered via scraping and as far as I’m aware there haven’t been any legal threats.

Was there some law that was passed that makes all web scraping legal or something?

Re:Oceans May Have Already Seen 1.7°C of Warming on Tuesday February 06, 2024 @12:29PM (#39277416)
Yea I’d love to. If you know of some concrete sources please link them!
Re:Oceans May Have Already Seen 1.7°C of Warming on Tuesday February 06, 2024 @12:20PM (#39277244)
Yes, and that’s been the line of thinking taught in schools and every discussion I’ve read on this topic for at least 20 years. Yet, there never seems to be any concrete proof that heating is being caused by excess energy being trapped inside the atmosphere because “emissions”. Again, it’s all very hand wavy.

I’m not saying that’s NOT the method of action, it totally could be, but I would think there would be more evidence nowadays compared to 20 years ago but there doesn’t seem to be. Everyone just parrots everyone else.

I’m just thinking of Occam’s razor. Perhaps the planet is getting hotter because were just producing a fuckload of heat. It doesn’t need to be anywhere near the energy the planet captures from the sun. But day after day, over decades, surely the minuscule amount of heat being generated by activity on the surface has SOME cumulative effect. Or maybe not, i dont know.

Re:Don't use NameCheap for the .fr TLD on Wednesday January 31, 2024 @09:21AM (#39204092)
Somewhat related, but does anyone know how to deal with a .us domain? There is no WHOIS privacy with that TLD. A few hours after I bought a .us domain, I started receiving phone calls from all over the world, literally every 5-10 minutes for days, offering services for my “new business” associated with the TLD.

Is there any way to keep legitimate contacts in the registrar without getting a ton of spam?

Isn’t python/django quite slow?

Ask HN: Best tech stack in 2024 to build a fast dashboard web app?

I have a new project that needs a landing page, a signup flow, and a dashboard section displaying some data from a database.I highly prefer simple, blazing fast websites like Hacker News and Craigslist that load near instantly.I’ve got a little experience with Rails, React, Java/Kotlin (Android), and node/express.Is there a particular tech stack that would be suitable for building something...

( Read More... | 8 comments | 2 points | on HN )
Re:Thailand finds 14.8M tonnes of lithium on Friday January 19, 2024 @09:18PM (#39064013)
Where was this?
Re:Pocketbase: Open-source back end in one file on Sunday January 07, 2024 @09:50AM (#38901636)
Isn’t that how any Go project is put online?

Ask HN: What is the best tech stack nowadays for mass scraping?

I’m in the design phase for a new project that will involve quite a bit of web scraping, formatting that data as appropriate and saving to a DB.The sources to be scraped are quite varied.I’ve got a little bit of experience with Node/Express and Ruby/Rails. I’m more than happy to pick up Go or Python/Django or Elixir or something else if those are more appropriate. I think my hesitation with...

( Read More... | 5 comments | on HN )
Re:I Love Ruby on Monday December 18, 2023 @10:13PM (#38691355)
There’s a lot of praise for Rust in these comments.

I always understood Rust to be for low level “close to the metal” sort of software. Is it at a point where it’s suitable for writing web applications?

I know it’s “possible” with frameworks like Rocket, but I’d like to know if Rust is at a point where it can compete in the web app space with Rails, Go, Node/Express, etc.

I’ve read opinions, perhaps presented as facts, that transforming commercial buildings into residential units was often more expensive than tearing down the whole building and starting from scratch.

If that’s true, there seems to be a large opportunity available to those who can figure out how to transform those buildings in a way cheaper than what’s currently possible.

What sort of API? I’m working on another real estate project and were focusing on generic listings APIs. Would love to know your use case.
What? There are tons of API businesses. Many of them are massive companies.

Ask HN: Have you suffered any long term side effects from the Covid vaccines?

Ok, obviously this is a touchy topic for some people, but it shouldn’t be. I figured HN is probably the most mature forum I am a part of to ask this, especially compared to reddit.I have not yet completed a primary vaccine course and was planning on finally getting my first shot on Friday (I’ll probably choose one of the two mRNA ones). Obviously, there must be more data on the main vaccines...

( Read More... | 7 comments | 4 points | on HN )
Re:Ask HN: Taking 6-12 months off work? on Sunday March 05, 2023 @05:16PM (#35034696)
I’m doing this now. Let me know if you need some recommendations or want to meet up (assuming you’re cool).

Definitely recommend it.

> who benefits (did benefit) by the leak

The worlds billionaires, combined, made more money in 2020-2022 than the previous 20 years combined. When there’s that much money involved, one must be a little suspicious.

I’m not much of a conspiracy theorist, but I always found it it little odd that the guy who became the de facto pandemic era “leader” in the U.S. was also the same guy that personally approved funding for the lab in Wuhan.

Ask HN: Has anyone suspected themselves of having “long Covid” and cured it?

I know HN is not medical forum but I genuinely don’t know where else to have this discussion; Reddit would result in nothing but argumentative discussion.I contracted Covid very early (early January 2020) while working in SF. I handled it well and of course at the time both myself and my doctor treated it as the flu after I assured her I had not recently visited China.It seems like since that...

( Read More... | 4 comments | 2 points | on HN )
Re:Ask HN: What is the best advice you got on any aspect of life? on Wednesday February 15, 2023 @12:05PM (#34806946)
I would be very interested in learning what that startup was called.
Most modern fighter jets have turbofan engines as well.
Re:Ask HN: What sub $200 product improved your 2022 on Friday January 06, 2023 @11:00AM (#34276207)
Isn’t there an ongoing investigation regarding an influx of tinnitus related to the ANC feature?
Related question: what would the folks here recommend for someone that wants to keep the frontend “stupid simple” while not resorting to writing everything in pure HTML/CSS/JS?

I’ve heard mithril.js recommended before but I’ve yet to try it. I have experience with Angular, React, and a bit of Ember and the amount of code and “magic” involved is absurd.

Re:Most Tracked Flight Right Now on Saturday November 12, 2022 @10:54AM (#33574193)
Why Argentina though?
Re:Redfin Cuts 13% of Staff, Shuts Down Home-Flipping Business on Wednesday November 09, 2022 @10:20AM (#33532818)
As a curiosity, how many people in this thread are home buyers that sat on the sidelines over the past year or two and are now waiting for prices to drop?

I’m in that camp and I’m starting to suspect there are enough people in that camp that any noticeable drop in prices will be immediately met by strong demand, even at current rates.

Re:Redfin Cuts 13% of Staff, Shuts Down Home-Flipping Business on Wednesday November 09, 2022 @10:15AM (#33532753)
What is SFR?
Re:Stripe Layoff 14% of Workforce on Thursday November 03, 2022 @10:15AM (#33451325)
Goodness, I’d voluntarily take that deal anyday. 3.5 months of paid vacation at the salaries Stripe pays? Yes please.

I just read the rest. On top of 3.5 months pay, they get accelerated vesting, cash payment for healthcare benefits, all unused PTO paid, and more. That’s incredible.

Re:Ask HN: Who wants to be hired? (November 2022) on Tuesday November 01, 2022 @11:31AM (#33422573)
Location: NYC

Remote: Yes

Willing to relocate: Most likely no, but depends on the opportunity

Technologies: Kotlin, Java, Android, Ruby, Javascript, Node.js, React, GraphQL, and all related development technologies (e.g. Git, other version control systems, ticketing platforms, etc.).

Résumé/CV: On request

Email: Check profile

Looking for part—time contracts, ideally for Android or Java/Kotlin development. Very senior dev, nearly 10 years of experience working with many of the top companies and startups in SF and NYC. I am extremely productive in a flexible part-time role, and regularly get more done in a shorter time than full time employees due to my experience.

Contact me if you’re looking for a professional developer with many years of experience working with a variety of teams in all sorts of companies.

Re:Meta Earning Results Q3 2022 [pdf] on Wednesday October 26, 2022 @04:58PM (#33349345)
Can someone make an argument against buying at this price point? It was what, 378 a year ago? It’s even cheaper than the crash in 2020.
FYI this was admitted by Psaki during a press conference, and referenced several times later.

Anyone paying attention should already be aware of what occurred. Whether or not it was illegal will be for the courts to decide.

Is there any evidence that companies (or rather senior staff at those companies) knowingly do that, or is it simply that once some innovation results in a new, large market, a government tries to get involved?

Older »