tsaoyu

In short, DPO is not better than PPO. This is because DPO is derived from so called BT reward assumption that pairwise data preference is collected. Through mathematical formulations, you can learn the preference and the action at the same time. However, PPO and other on-policy (training samples are strictly generated by the LLM) doesn't need such assumption. For example, in coding and math problems it is possible to get binary reward. Many research shows DPO is ok if you don't take much care on OOD performance.

Click to play [...the video]

Very cool. Robots are edge centric at this moment but 5G and other technologies might enable the cloud applications such as https://github.com/BerkeleyAutomation/FogROS2 .

Agree, aerial vehicles are slightly better than maritime vehicles in this sense. I left maritime robotics because I couldn’t find any decent paying job that is not defense related :( What we can do as a student team is to open-source it.

I can understand the concerns of the technology might be abused in DoD but I should point out that it is much better to see this result on Science Robotics, TRO, ICRA, and IROS etc. Military is behind many technology innovations but this doesn't mean all technologies should be used for military purpose only.

The work done is by:

http://zju-fast.com/

Disclaimer: Roboticist, have worked with fast-lab on World Robotics Sailing Championship

This is a hybrid Remote Operated Vehicles (ROVs) and Autonomous Underwater Vehicles (AUVs). The vehicle can be controlled using a joystick(^1) using a wired connection while operating as a ROVs.

1. https://youtu.be/uXA0AkcrNoo?t=192 (DualShock4 actually)

Every year we upgrade our autonomous sailboat controller to the latest Raspberry Pi. This year we face a situation to choose from Jetson Nano and RPi 4. Even the decision is hard to made, now is an exciting moment for robot makers.

Maritime and airplane emission is definite an issue after the grid power transferred to renewables. The problem is the low energy density and the variance in renewable resources. I guess for transportation it is more practical to aim for net carbon neutral.

Reminds me 锟斤拷 due to Unicode replacement character misinterpretation problem. When placeholder 'U+FFFD' decoded using GBK it will displayed as these characters. Some of glitches can still be found online, e.g., https://docs.oracle.com/cd/E19199-01/817-4244-10/preface.htm...

Some examples on the usage of synchronous languages: http://zelus.di.ens.fr/examples.html#ex-bouncingball

Ordered a paper version on Amazon UK one month ago. Does anyone get the book already?

I remember the fun time when I hacking into a CASIO fx-82ES. There is a unsolder jumper on PCB that can 'upgrade' 82ES to 991ES which has four more functions. http://www.instructables.com/id/Upgrade-your-Casio-fx-82es-i...

The quality of those calculators are amazing, thanks for creating all of those, R.I.P

I had a great fun in taking photos using a 3D printed pinhole lens on my Sony A7 II body. Here are some sample images: https://flic.kr/s/aHsmmwzBQg

Indeed, we have a previous team (robotics sailing team) member now working at ASV UK. A very exciting job

We build an open-source sailing boat (MIT license) https://blog.sotonsailrobot.org and we will host World Robotics Sailing Championship this year https://www.roboticsailing.org/2018/

A short list of the other attempts on bio-inspired underwater robots:

* Fish https://seagrant.mit.edu/publications/MITSG_00-4J.pdf * Octopus https://phys.org/news/2015-04-octopus-inspired-robotthe-fast... * Snake https://eelume.com/ * Jellyfish http://www.emdl.mse.vt.edu/projects/alex.html * Manta Ray https://www.usnews.com/news/news/articles/2017-12-04/singapo...

Great business idea. Here is the freshly made AD[1]. Curious to see if there is any business plan follow ups.

[1](https://i.imgur.com/oD50taU.png)

Same curious, it has Python extension but not really close to it.

I assume this situation also holds true for those using LabView to build their virtual instruments. IP wasn't really an issue for us since we have decided to open-source our project to broaden the knowledge of the public: https://github.com/Maritime-Robotics-Student-Society/sailing...

As a note, in Python, there is pyconcrete for code encryption. https://github.com/Falldog/pyconcrete

Mathematica/Python/MATLAB user. Mathematica and MATLAB do both have great documentation and intuitive examples shipped with their product, however, document your own code using their system is surprisingly hard (compared to Sphinx). Jupyter learnt the idea of the notebook from Mathematica (and some other notebook based math software) but the killer point is that it extends itself to more and more general purpose programming language with Python, R, Julia and even C/C++ kernels. MATLAB still popular in the field of control engineering, communication partly because of its SIMULINK simulation environment. I have been looking for a Python alternative but the closest I have found so far is Modelica. In my workflow, Mathematica is used to derive the mathematical formula, Matlab for simulation and finally software is written and distributed as Python package.