FineWeb: 15 trillion tokens of high quality web data the web has to offer.
The 🍷 dataset consists of more than 15T tokens of cleaned and deduplicated english web data from CommonCrawl.
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
The LASSIE project is preparing for a time when people and robots explore space together.
Learn more about how the #space economy can improve life on #Earth from our new insight report, ‘Space: The $1.8 Trillion Opportunity for Global Economic Growth’:
Space is approaching a new frontier. The space economy is expected to be worth $1.8 trillion by 2035 as satellite and rocket-enabled technologies become increasingly prevalent, according to a new report.
Continue reading “Space is booming. Here’s how to embrace the $1.8 trillion opportunity” »
Everyone is in a big hurry to get the latest and greatest GPU accelerators to build generative AI platforms. Those who can’t get GPUs, or have custom devices that are better suited to their workloads than GPUs, deploy other kinds of accelerators.
The companies designing these AI compute engines have two things in common. First, they are all using Taiwan Semiconductor Manufacturing Co as their chip etching foundry, and many are using TSMC as their socket packager. And second, they have not lost their minds. With the devices launched so far this year, AI compute engine designers are hanging back a bit rather than try to be on the bleeding edge of process and packaging technology so they can make a little money on products and processes that were very expensive to develop.
Nothing shows this better than the fact that the future “Blackwell” B100 and B200 GPU accelerators from Nvidia, which are not even going to start shipping until later this year, are based on the N4P process at Taiwan Semiconductor Manufacturing Co. This is a refined variant of the N4 process that the prior generation of “Hopper” H100 and H200 GPUs used, also a 4 nanometer product.
Construction is the world’s largest industry, employing seven percent of the planet’s working-age adults, contributing 13 percent of the world’s GDP and completing floor space equivalent to the city of Paris every seven days.
The construction industry is also the most inefficient, least digitised and most polluting industry (37% of ALL emissions), so change is imperative from macro economic necessity alone. For the builders of the world faced with a jigsaw puzzle of partial digital solutions and chronic labor and supply chain issues, the margins are growing ever-thinner and the necessity is to change or perish.
British company Automated Architecture (AUAR) has a thoroughly ingenious solution and it has enlisted an all-star cast of financial backers in short order: Morgan Stanley, ABB Robotics, Rival Holdings (USA), Vandenbussche NV (Belgium) with VCs such as Miles Ahead and Bacchus Venture Capital (Jim Horowitz et al) helping to get the initial idea off the ground.
Scientists developed a device that combines wind and solar to harvest clean energy more efficiently and create a self-cleaning solar panel.
The “it” Mr Woodman is referring to is Sora, a new text-to-video AI model from OpenAI, the artificial intelligence research organisation behind viral chatbot ChatGPT.
Instead of using their broad technical skills in filmmaking, such as animation, to overcome obstacles in the process, Mr Woodman and his team relied only on the model to generate footage for them, shot by shot.
“We just continued generating and it was almost like post-production and production in the same breath,” says Patrick Cederberg, who also worked on the project.
Meta CEO Mark Zuckerberg thinks ‘feedback loops,’ the process of AI learning from its own outputs, are more important than new data for developing AI.
Haven’t posted in a while, my mother is not doing well, had to take her to the ER the other day, but this is important and I hope it sets a trend of cooperation.
When NASA returns to the Moon, its astronauts will enjoy tooling around in a pressurized camper van courtesy of JAXA and Toyota. The two-person vehicle is part of a US/Japan agreement that includes putting the first Japanese astronauts on the Moon.
It’s beginning to look like NASA’s program to establish a permanent human presence on the Moon will resemble a car show as much as it does a scientific expedition. The space agency recently awarded contracts to develop an open off road vehicle to carry astronauts around on the Moon, though these are small and the driver and passengers have to wear spacesuits. Meanwhile, the Japanese vehicle being developed by JAXA and Toyota is a mobile outpost where the crew can live and work for up to 30 days in a shirt sleeve environment.
Continue reading “Japan to build NASA a pressurized Moon campervan for 30-day trips” »
Scientists have caught a once-in-a-billion-years evolutionary event in progress, as two lifeforms have merged into one organism that boasts abilities its peers would envy. Last time this happened, Earth got plants.
The phenomenon is called primary endosymbiosis, and it occurs when one microbial organism engulfs another, and starts using it like an internal organ. In exchange, the host cell provides nutrients, energy, protection and other benefits to the symbiote, until eventually it can no longer survive on its own and essentially ends up becoming an organ for the host – or what’s known as an organelle in microbial cells.
Imagine if kidneys were actually little animals running around, and humans had to manually filter their blood through a dialysis machine. Then one day some guy somehow gets one of these kidney critters stuck… Internally (who are we to judge how?) – and realizes he no longer needs his dialysis machine. Neither do his kids, until eventually we’re all born with these helpful little fellas inside us. That’s kind of what’s happening here.
The researchers found that the ability to tolerate pain played a role in this apparent protective effect.
That explains why being active could lower the risk of having severe chronic pain, whether or not it was widespread throughout the body.
“This suggests that physical activity increases our ability to tolerate pain and may be one of the ways in which activity helps to reduce the risk of severe chronic pain,” says Årnes.
