News for hackers. Stuff that matters.

nuitblanche

Re:Photonic Computing for Transformative AI on Sunday July 11, 2021 @08:19AM (#27800230)
Hi,

I am Igor Carron, the CEO of the company.

Our technology is different than the one used by Lightmatter and Lightelligence. We currently do not do integrated photonics.

We are starting from the ground up by first building a photonic co-processor that does one function (to be extended) of general interest to AI. the current function is a random projection. We believe that it will be complexified over time as we grow. But our particular focus is on those computations that are difficult to perform in electronics. In particular, our recent focus has been on Transformers/Large Language Models where we think our technology will be a game changer in the training and inference of these gigantic Machine learning models. For the training part, we published two papers at NeurIPS last year in the main conference. We also presented a more detailed one at one of the workshop: https://arxiv.org/abs/2012.06373 We are going to present a poster at HotChips this year about our foray in HPC: https://arxiv.org/abs/2104.14429 Other papers in AI are listed at the LightOn AI research page: https://lair.lighton.ai/

Physically, speaking, the Optical Processing Unit fits into a 2U rack (currently our focus has not been to miniaturize yet, we avoid permature optimization) that is connected to a CPU bus through a PCIe connection.

The technology has been running for the past three years anf half in datacenters for the oldest prototypes (we just decommisioned one a month ago or so) with Machine Learning computation unit tests being performed every ten minutes during that time period.

We are making the technology available for researchers to use on our LightOn Cloud cluster (https://cloud.lighton.ai/what-is-lighton-cloud/) and people can even rent one or several OPUs (LightOn Appliance: https://lighton.ai/lighton-appliance/ ).

I agree, we need to redesign our website.

Igor.

Re:USA windpower now producing over 43,000 megawatts on Monday November 07, 2011 @12:17PM (#3207141)
Let us note that, from the article, this translates into only 3 percent of total electricity generated nationwide. This is in large part due to the inability for wind power to generate a constant power load. From what I recall the nuclear power plants can produce a load of about 100 x 1400 MW = 140,000 MW and this is estimated to be about 20 percent of the elctricity produced nationwide.

Roughly speaking it looks like the nuclear power plants have three times as much installed capacity than solar and produce 6 times as much power to the grid. Since the nuclear power plants are near 100 percent capacity, I wonder what is the reason why wind has roughly a 50 percent production capability: is it maintenance or wind availability ?

This is so dumb! I stopped reading after they mentioned this e-cat worked with hydrogen.

Hydrogen is not an energy source. It is not available in nature and has to be produced with .... power.

A reference page for Matrix Factorization

Since a great many algorithms behind collaborative filtering, clustering and so forth used by the likes of Google, Facebook, LinkedIn rely on advanced matrix factorization and this field is seeing some important growth. I just compiled a list of different recent algorithm that have sprung up as a result of faster convex optimization softwareand other field such as compressed sensing. It is...

( Read More... | no comments | on HN )
Re:How Perceptual Hashes Work on Monday June 06, 2011 @12:53PM (#2625380)
I developed my answer there:

Are Perceptual Hashes an instance of Compressive Sensing ? http://nuit-blanche.blogspot.com/2011/06/are-perceptual-hash...

Re:How Perceptual Hashes Work on Monday June 06, 2011 @04:24AM (#2624087)
I agree. Briefly looking at the description of it, it is some sort of compressed sensing. The differences from traditional CS are minimal in fact, but the scheme is in line with some of the work undertaken in manifold signal processing. The differences are: - the proposed hash is deterministic, generally in CS, you want to rely on random projections (yet there are some results for deterministic problems) in order to get some sort of universality and by the same token some sort of robustness. - step 3 and 4, are the most fascinating steps because they are clearly one of the approaches used in manifold signal processing for images. To summarize, in order for pictures to be close to each other on a manifold, you really want to defocus them. I'll put something on my blog on the matter. This is the reason why the has of two images next to each other are close in the "hash" or manifold space. - for one image, the hash seems to provide 16 measurements (16 bits of the hash result). That would be OK if the initial picture was at the size and color of the picture after step 1 and 2. So in effect, that information is lost. However, in CS you also have "lossy" scheme such as the 1-bit compressed sensing approach (there you retain only the sign of the measurement!, i.e. a little bit like step 6). The reconstruction of these 1-bit pictures are not the original but they are close).

(ps: I write a small blog on CS).

Re:What algorithm blows your mind? (Reddit compsci) on Friday October 29, 2010 @07:55AM (#1846956)
I ahve compiled a long list of online talks here: https://sites.google.com/site/igorcarron2/csvideos

start from the bottom.

Re:What algorithm blows your mind? (Reddit compsci) on Friday October 29, 2010 @07:53AM (#1846951)
In compressed sensing, we don't do guesses. Guesses are reserved for inpainting.
Re:What algorithm blows your mind? (Reddit compsci) on Friday October 29, 2010 @07:52AM (#1846948)
FWIW, some of these algorithms: Bloom filters, Error Correcting Codes are connected to the Compressive Sensing.
Re:What algorithm blows your mind? (Reddit compsci) on Friday October 29, 2010 @07:49AM (#1846939)
The Wired articles gave the wrong impression. It gave an example of inpainting (the Obama picture) that is NOT compressed sensing. Compressed sensing on the other hand can be applied directly to MRI because the MRI machine actually picks up all the spatial information. It samples randomly in the Fourier domain thereby having access to all the spatial information needed to fully reconstruct an image. It used to be that the reconstruction algorithms were not that good before (they relied on SVD/least square). Candes, Tao, Romberg and Donoho then published papers showing that the reconstruction could be done in a totally different way AND it was exact. With these new reconstruction algorithms something like MRI data is acquired in a much more efficient manner than four years because of compressed sensing.

For mor eon the controversy with the Wired article: http://nuit-blanche.blogspot.com/2010/05/compressed-sensing-... http://nuit-blanche.blogspot.com/2010/03/why-compressed-sens...

The new reconstruction solvers: https://sites.google.com/site/igorcarron2/cs#reconstruction

Hardware that are implementing compressive sensing: https://sites.google.com/site/igorcarron2/compressedsensingh...

Ask HN: Your most awesome experience (UI/computation/language...)?

Here are three examples of what I call awesome experiences and while they are a little dated, I still cherish them. They are also very easy recalls as I can say exactly what changed at the moment I first used these models/processes:<p>* Back in the days, I used to write most of my graudate research with Fortran generated results... the process was excruciating. Then one day, I discovered...

( Read More... | no comments | on HN )
Re:Ask HN: An academic web app idea, anyone interested? on Sunday September 05, 2010 @06:30PM (#1665324)
Techlens does not cover preprints!
Re:Ask HN: An academic web app idea, anyone interested? on Sunday September 05, 2010 @05:27PM (#1665220)
I don't think Techlens would do well with preprints.
Re:Ask HN: An academic web app idea, anyone interested? on Sunday September 05, 2010 @05:15PM (#1665190)
In my case, Google alert is part of my mix.
Re:Ask HN: An academic web app idea, anyone interested? on Sunday September 05, 2010 @03:20PM (#1664987)
Ali,

I have some experience in the process of doing the filtering you are mentioning as I write a blog on compressed sensing (http://nuit-blanche.blogspot.com/), a field that spans a wide range of communities that are, often, not talking to each other nor have the same culture.

I don't think Mendeley or any RSS feed services help much as they both target the same dead tree people who are generally about two years behind on the good stuff. Arxiv is good but not all the communities use arxiv either and so it really is a mix of different tools that yield the most results.

I have a high interest in expanding and automating my current processes and would be very much willing to talk to somebody who would want to spend some time on this.

I also agree with one of the posters, how much do you think people would be willing to pay for this service ?

Ask HN: Mindmaps for blog entries: Is there a code for that ?

I run a blog that is highly technical (http://nuit-blanche.blogspot.com) and I pay special attention to link back to previous entries relevant to new posts. However, in the past few months, I have run into the issue of trying to find back some entries but could not do that very well using the search engine that sits on top of the blog and I am wondering if the following piece of software...

( Read More... | 1 comment | 2 points | on HN )

Ask HN: Hundred of thousand of people stuck on the wrong continent.

Is any anybody interested in developing a solution that would help these travelers sutck on the wrong continent ?<p>For some academics, here is what I am proposing in my community:<p>http://nuit-blanche.blogspot.com/2010/04/cs-lets-make-lemonade-out-of-lemons.html<p>Could it be extended to a larger set of people ? Your thoughts.

( Read More... | no comments | 4 points | on HN )
The small problem with GPGPU is that one aspect of this project is to look at several reconstruction solvers (as they are being called in compressed sensing). Not all of these solvers are clearly amenable to a GPU approach. The idea is really to make it easy for new reconstruction algorithm to be tested on these phase transition maps as opposed to a dedicated effort at re-thinking the algorithm so that it can fit the GPU architecture.
Let me rephrase the question to see if I understand it correctly:

Why do you go for a single piece of hardware when in fact, you could already do this on several GPGPUs and one CPU or use several CPUs on the cloud.?

It could probably be done using these techniques but the answer resides in the fact that if the computation of the phase transition is done very fast for a particular "measurement matrix" (i.e. a particular "sensor") then we could foresee its use in near-real time in instances where the "measurement matrix" would be time dependent (such as the atmosphere....). This would be important in that it would allow to figure out if these new "sensors" can be actually used (as opposed to being mere lab constructions).

Older »