How Financial News Can Be Used to Train Good Financial Models š° Numbers tell you what happened, but news tells you why. Iāve written an article explaining how news can be used to train AI models for sentiment analysis and better forecasting. Hope you find it interesting!
Given a news title, it calculates a sentiment score : if the score crosses a certain threshold, the strategy decides to buy or sell. Each trade lasts one day, and the strategy then computes the daily return. For Tesla the best model seems to be the regression š Just a quick note: the model uses the closing price as the buy price, meaning it already reflects the impact of the news.
How Financial News Can Be Used to Train Good Financial Models š° Numbers tell you what happened, but news tells you why. Iāve written an article explaining how news can be used to train AI models for sentiment analysis and better forecasting. Hope you find it interesting!
Given a news title, it calculates a sentiment score : if the score crosses a certain threshold, the strategy decides to buy or sell. Each trade lasts one day, and the strategy then computes the daily return.
Just a quick note: the model uses the closing price as the buy price, meaning it already reflects the impact of the news. If I had chosen the opening price, the results would have been less biased but less realistic given the data available.
I found it excellent and very well done. One of the best explanations of embedding I've ever read. Well done, @hesamation! Had to share this: hesamation/primer-llm-embedding
Finally, I uploaded the model I developed for my masterās thesis! Given a financial event, it provides explained predictions based on a dataset of past news and central bank speeches. Try it out here: SelmaNajih001/StockPredictionExplanation (Just restart the space and wait a minute)
While Hugging Face offers extensive tutorials on classification and NLP tasks, there is very little guidance on performing regression tasks with Transformers. In my latest article, I provide a step-by-step guide to running regression using Hugging Face, applying it to financial news data to predict stock returns. In this tutorial, you will learn how to: -Prepare and preprocess textual and numerical data for regression -Configure a Transformer model for regression tasks -Apply the model to real-world financial datasets with fully reproducible code
Predicting Stock Price Movements from News š°š I trained a model to predict stock price movements (Up, Down, Neutral) from company news. Dataset: Articles linked to next-day price changes, covering Apple, Tesla, and more. Approach: Fine-tuned allenai/longformer-base-4096 for classification. Outcome: The model captures the link between news and stock movements, handling long articles and producing probability scores for each label. Comparison: Shows promising alignment with stock trends, sometimes outperforming FinBERT. Feel free to try the model and explore how news can influence stock predictions SelmaNajih001/SentimentAnalysis
hey hey @mradermacher - VB from Hugging Face here, we'd love to onboard you over to our optimised xet backend! š„
as you know we're in the process of upgrading our storage backend to xet (which helps us scale and offer blazingly fast upload/ download speeds too): https://huggingface.co/blog/xet-on-the-hub and now that we are certain that the backend can scale with even big models like Llama 4/ Qwen 3 - we;re moving to the next phase of inviting impactful orgs and users on the hub over as you are a big part of the open source ML community - we would love to onboard you next and create some excitement about it in the community too!
in terms of actual steps - it should be as simple as one of the org admins to join hf.co/join/xet - we'll take care of the rest.
What inspired the Transformer architecture in the "Attention Is All You Need" paper? And how were various ideas combined to create this groundbreaking model?
In this lengthy article, I explore the story and the origins of some of the ideas introduced in the paper. We'll explore everything from the fundamental attention mechanism that lies at its heart to the surprisingly simple explanation for its name, Transformer.
š” Examples of ideas explored in the article:
ā What was the inspiration for the attention mechanism? ā How did we go from attention to self-attention? ā Did the team have any other names in mind for the model?
and more...
I aim to tell the story of Transformers as I would have wanted to read it, and hopefully, one that appeals to others interested in the details of this fascinating idea. This narrative draws from video interviews, lectures, articles, tweets/Xs, and some digging into the literature. I have done my best to be accurate, but errors are possible. If you find inaccuracies or have any additions, please do reach out, and I will gladly make the necessary updates.
š We're excited to introduce MemoryCode, a novel synthetic dataset designed to rigorously evaluate LLMs' ability to track and execute coding instructions across multiple sessions. MemoryCode simulates realistic workplace scenarios where a mentee (the LLM) receives coding instructions from a mentor amidst a stream of both relevant and irrelevant information.
š” But what makes MemoryCode unique?! The combination of the following:
ā Multi-Session Dialogue Histories: MemoryCode consists of chronological sequences of dialogues between a mentor and a mentee, mirroring real-world interactions between coworkers.
ā Interspersed Irrelevant Information: Critical instructions are deliberately interspersed with unrelated content, replicating the information overload common in office environments.
ā Instruction Updates: Coding rules and conventions can be updated multiple times throughout the dialogue history, requiring LLMs to track and apply the most recent information.
ā Prospective Memory: Unlike previous datasets that cue information retrieval, MemoryCode requires LLMs to spontaneously recall and apply relevant instructions without explicit prompts.
ā Practical Task Execution: LLMs are evaluated on their ability to use the retrieved information to perform practical coding tasks, bridging the gap between information recall and real-world application.
š Our Findings
1ļøā£ While even small models can handle isolated coding instructions, the performance of top-tier models like GPT-4o dramatically deteriorates when instructions are spread across multiple sessions.
2ļøā£ This performance drop isn't simply due to the length of the context. Our analysis indicates that LLMs struggle to reason compositionally over sequences of instructions and updates. They have difficulty keeping track of which instructions are current and how to apply them.