←
HapticAI232 posts
HapticAI avatar

HapticAI

@Haptic_AI

Your LLM’s personal trainer. Get with the program, nerds.

◷ Joined March 2024▧ 39 Photos and videos
HapticAI avatar
HapticAI@Haptic_AI·3 May 2024

The HapticAI beta is right around the corner, and we'd like to take this opportunity to announce our next partner, @heurist_ai! Heurist is a DePIN protocol for AI inference 👾 Find more details about this partnership at the blog link below or read on for a quick summary 🧵 👇 medium.com/@hapticaidev/hapt…

HapticAI avatar
HapticAI@Haptic_AI·9 Dec 2024

Multi-Agent Reinforcement learning (MARL) is the Future of training the next generation of AI applications

HapticAI avatar
HapticAI@Haptic_AI·6 Dec 2024

👀

Sam Altman@sama6 Dec 2024

today we are announcing reinforcement finetuning, which makes it really easy to create expert models in specific domains with very little training data. livestream going now: openai.com/12-days/ alpha program starting now, launching publicly in q1

HapticAI avatar
HapticAI@Haptic_AI·4 Dec 2024

This is where Haptic can provide a valuable service to upcoming AI agents. To avoid malicious feedback this ability can be token gated to top holders and aligned users

HapticAI avatar
HapticAI@Haptic_AI·4 Dec 2024

Feedback is something that can be crowdsourced and becomes the easiest way to level up these agents What if users and token holders can signal to the AI agent which of their responses are appreciated by the users and which responses seem like low quality responses

HapticAI avatar
HapticAI@Haptic_AI·4 Dec 2024

Programmatic Upgrades - Controlled by either the deployer of the AI agent or platform wide upgrades introduced by the Agentic platform team Data Quality - Work intensive process of acquiring relevant and non repetitive data to improve the agent through retraining

HapticAI avatar
HapticAI@Haptic_AI·4 Dec 2024

How will the winning agents be differentiated from every other AI agent out there replying to twitter posts? Through constant upgrades, training data richness and Feedback on their response generation

Nathan Lambert avatar
⟳ HapticAI retweeted
Nathan Lambert@natolambert·4 Nov 2024

Tulu 2.5 work is still underrated RLHF paper. Lots of industry interest, not that much immediate academic uptake. Really great empirical study on how DPO and PPO work across datasets and implementation. Core to a lot of our efforts on Tulu 3.

Post attachment
HapticAI avatar
HapticAI@Haptic_AI·27 Nov 2024

If you are a team or developer looking to build and deploy your AI agents - feel free to DM us and hop on a call

HapticAI avatar
HapticAI@Haptic_AI·27 Nov 2024

RLHF isn't just about making AI agents better - it's about making them better partners for humans. It's a bridge between raw capability and practical utility.

HapticAI avatar
HapticAI@Haptic_AI·27 Nov 2024

Another Future development we are looking to include in our product suite that will unlock major upgrades for partners: Multi-agent RLHF - Agents training each other further Automated feedback loops

HapticAI avatar
HapticAI@Haptic_AI·27 Nov 2024

Real-world improvements from RLHF that Agent creators can expect by integrating Haptic's RLHF: 1- More natural dialogue 2- Better task comprehension 3- Improved safety boundaries 4- Enhanced reasoning

HapticAI avatar
HapticAI@Haptic_AI·27 Nov 2024

Solution approaches our team has been exploring in the last month: 1- Diverse evaluator pools 2- Structured feedback frameworks 3- Iterative refinement loops 4- Robust validation methods

HapticAI avatar
HapticAI@Haptic_AI·27 Nov 2024

Common challenges in RLHF that become more challenging with improving Agentic behavior 1- Reward hacking 2- Preference inconsistency 3- Scaling human feedback quickly to keep up with the Agents outputs 4- Maintaining model stability