Good Morning! Hugging Face and NVIDIA are teaming up to bring you inference-as-a-service, making AI more accessible than ever. In a breakthrough for data transmission, scientists at Aston University have pushed the limits, achieving mind-blowing speeds of 402 Tbps. And Amazon’s been ordered to recall over 400,000 potentially dangerous products, so double-check your recent purchases.

— Forrest Knight & Meghanadh Vasireddy

Hugging Face and NVIDIA Unveil Inference-as-a-Service Partnership

Hugging Face has joined forces with NVIDIA to launch an inference-as-a-service offering, leveraging NVIDIA's NIM (NVIDIA Inference Microservices) technology on DGX Cloud. This collaboration aims to democratize AI inference for Hugging Face's 4 million developers.

Key features:

• Rapid deployment of popular LLMs like Llama 3 and Mistral AI models

• Optimization via NVIDIA NIM microservices on DGX Cloud

• Up to 5x higher throughput for models like the 70B-parameter Llama 3

• Serverless inference for Enterprise Hub users

• Standardized OpenAI-compatible API

This new offering plays nice with their Train on DGX Cloud service, so you've got a full AI development playground at your fingertips. And it's super easy to access – just look for the "Train" and "Deploy" drop-downs on Hugging Face model cards.

Pricing-wise, they're charging based on compute time, with H100 GPUs running at $8.25/hour. Oh, and keep an eye out – they're hinting at integrating NVIDIA TensorRT-LLM into Hugging Face's Text Generation Inference framework.

Read More Here

Scientists Reach Data Transfer Speeds Shatter Records at 402 Tbps

Scientists at Aston University have set a new benchmark in fiber-optic data transmission, reaching an unprecedented speed of 402 terabits per second (Tbps). This achievement represents a 25% improvement over their previous record of 301 Tbps, established just months earlier.

Key advancements:

• Utilization of all six wavelength bands (O, E, S, C, L, and U) in commercial fiber-optic cables

• Full exploitation of the 1,260-1,675 nm infrared spectrum

• Development of novel U-band amplification techniques

• Integration of off-the-shelf O-band amplifiers

Notably, they accomplished this using standard fiber infrastructure, eliminating the need for specialized cabling. The research the team has one has implications for expanding communication capacity to meet rapidly increasing data demands.

Read More Here

Amazon Forced to Recall 400K Potentially Lethal Products

Amazon has been ordered by the US Consumer Product Safety Commission (CPSC) to recall over 400,000 hazardous products sold by third-party vendors on its platform. The decision came after Amazon failed to inform more than 300,000 customers about severe risks associated with these items, including death and electrocution.

Key points:

• Products involved include highly flammable children's pajamas, faulty carbon monoxide detectors, and unsafe hair dryers

• CPSC unanimously voted to hold Amazon legally responsible as a distributor under the Consumer Product Safety Act

• Amazon's previous notifications to customers were deemed insufficient, downplaying the severity of hazards

The CPSC criticized Amazon's approach, noting that the company:

• Avoided using the word "recall" in communications

• Failed to include product photos in notifications

• Provided no way for customers to respond

• Made no effort to track product destruction or message open rates

Amazon plans to appeal the ruling, stating they had promptly notified customers and issued refunds when initially informed of the issues. However, the CPSC remains concerned about potential ongoing risks, especially for products that may have entered secondary markets.

Read More Here

🔥 More Notes

• Windows Security best practices for integrating and managing security tools

• Qt Creator 14: C++ Code Model Update

• Logitech has an idea for a “forever mouse” that requires a subscription

Youtube Spotlight

Expert Explains the Hidden Crowd Engineering Behind Event Venues | WSJ Pro Perfected

Was this forwarded to you? Sign Up Here