Forecasting is an important tool in the data science toolkit, and its value is especially clear for ride-hailing platforms like Lyft, where understanding granular supply and demand dynamics is critical. In a recent tech blog, Lyft’s engineering team shared how they tackle this challenge through real-time spatial-temporal forecasting—predicting demand and supply every 5 minutes across millions of small geographic cells. The team evaluated two major model families for this task: classical time-series models and deep neural networks. Deep learning performs well in offline settings because it captures richer spatial and temporal patterns. But in real-time environments—where models must be retrained frequently and run with ultra-low latency—classical models often outperform. Their ability to refit every few minutes makes them better at handling sudden spikes, especially for short-term predictions within 5 to 30 minutes. Engineering cost is also a major factor. Deep learning requires heavy GPU compute and more operational overhead, while classical models are lightweight, inexpensive at scale, and easier to maintain. This study is a great reminder that practical ML is all about balance. The most accurate model on paper isn’t always the best model in production. Understanding the nature of the data, the latency constraints, and the operational cost often matters just as much as the algorithm itself. #DataScience #MachineLearning #Algorithm #Forecasting #TimeSeries #Tradeoff #SnacksWeeklyonDataScience – – – Check out the "Snacks Weekly on Data Science" podcast and subscribe, where I explain in more detail the concepts discussed in this and future posts: -- Spotify: https://lnkd.in/gKgaMvbh -- Apple Podcast: https://lnkd.in/gFYvfB8V -- Youtube: https://lnkd.in/gcwPeBmR https://lnkd.in/gGK4E9qj
Tech Market Analysis Tools
Explore top LinkedIn content from expert professionals.
-
-
5 Ways Semiconductor Companies Forecast Demand Despite Long Lead Times and Highly Cyclical Markets 1. Customer Collaboration & Long-Term Supply Agreements (LTSAs) Companies secure 12–36 month forecasts from major customers. Use NCNR (non-cancellable, non-returnable) contracts to lock demand. Example: TSMC receives long-range demand plans from Apple for iPhone SoCs, enabling early wafer allocation. Infineon gets multi-year volume commitments from automotive OEMs for power MOSFETs and MCUs. 2. Multi-Quarter Order Backlog & Pipeline Analysis Continuous analysis of book-to-bill ratios, backlog ageing, and order cancellations. Sharp reductions in bookings often signal a market downcycle. Example: During the 2021 chip shortage, NXP and STMicroelectronics used 6–9 month backlogs to justify increasing wafer starts at foundries. When PC demand crashed in 2022, Intel’s falling book-to-bill warned of overcapacity. 3. Market Intelligence & Macro Indicators Track global semiconductor reports, sector growth, and end-market signals (EVs, cloud, consumer electronics). Example: ON Semiconductor monitors EV adoption forecasts to model future SiC MOSFET needs. Smartphone shipment trends from IDC/Gartner help Qualcomm and MediaTek predict next-year modem and SoC demand. 4. Statistical & Scenario-Based Forecast Models Use historical patterns (seasonality of consumer devices), inventory ratios, and regression models. Run best-case, base-case, and worst-case scenarios. Example: NVIDIA forecasts GPU demand by modeling cloud capex cycles from Amazon, Google, and Microsoft. Memory makers (Samsung, Micron) use scenario models when DRAM/NAND prices swing due to oversupply. 5. Channel Monitoring & Inventory Tracking Track distributor inventory, sell-in vs. sell-through, and sudden stock build-up. A spike in distributor stock often indicates demand softening. Example: Texas Instruments (TI) closely monitors distributor inventory days; rising inventory signals that the industrial market is slowing. Analog Devices (ADI) checks if sensor ICs are stuck in channels instead of reaching OEMs. ~~~~~~ If you are looking to invest in semiconductors and need expert insights, drop us a DM.
-
Startups don’t fail because they lack data. They fail because they don’t use it to predict. At the growth stage, everything feels urgent: Scaling teams Managing burn Driving revenue Making fast decisions But most of those decisions are based on gut feel or past trends. What if you could actually see what’s coming next? That’s where predictive analytics comes in. Here’s how it helps: 1. Revenue Forecasting → Which customer segments will drive growth next quarter? → What’s your likely MRR based on current momentum? 2. Churn Prediction → Who’s about to leave your platform or unsubscribe? → What action can you take to retain them? 3. Inventory & Demand Planning → What should you produce or stock more of? → Where are you overinvesting? 4. Hiring & Resource Allocation → Which roles will bottleneck growth if not filled? → Where is your team overstaffed? 5. Marketing ROI Forecasts → Which campaigns will likely convert highest based on behavior patterns? → Where should you double down? Most growing startups operate reactively. Predictive analytics flips that Giving you a forward looking lens to make smarter, faster and more scalable decisions. Curious how we help startups scale using predictive analytics? DM me. I’ll show you what’s working. #PredictiveAnalytics #Startups #Growthstrategy #business
-
𝗝𝗣𝗠𝗼𝗿𝗴𝗮𝗻 𝗧𝗮𝘂𝗴𝗵𝘁 𝗔𝗜 𝘁𝗵𝗲 𝗟𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗼𝗳 𝗠𝗮𝗿𝗸𝗲𝘁𝘀 JPMorgan researchers built a foundation model that predicts the next trade event the way an LLM predicts the next word — and it transferred to foreign markets it had never seen. TradeFM is a 524-million-parameter model trained on 10.7 billion tokens drawn from more than 9,000 U.S. equities across 368 trading days. Instead of language, its vocabulary is market microstructure: timing, size, price depth, and direction, compressed into 16,384 composite trade event tokens. 𝗪𝗵𝗮𝘁 𝘁𝗵𝗲𝘆 𝗱𝗶𝗱: • Trained on U.S. equity trade-flow data from February 2024 to September 2025 • Tested inside a simulated exchange where the model predicts trades in a continuous loop • Evaluated across 9 stocks, 3 liquidity tiers, and 9 months of held-out data — then applied, without any adjustments, to China and Japan 𝗪𝗵𝗮𝘁 𝘁𝗵𝗲𝘆 𝗳𝗼𝘂𝗻𝗱: • TradeFM matched real market patterns 2 to 3 times more closely than a standard baseline • Japan uses batch auctions at the open. China imposes 10% daily price limits. Performance degraded only moderately on both — without retraining Arman Khaledian, a former quant at Millennium and now CEO of Zanista AI, said: "That's not a toy result. 𝗜𝘁 𝗺𝗲𝗮𝗻𝘀 𝘁𝗵𝗲 𝗺𝗼𝗱𝗲𝗹 𝗶𝘀 𝗽𝗶𝗰𝗸𝗶𝗻𝗴 𝘂𝗽 𝘀𝗼𝗺𝗲𝘁𝗵𝗶𝗻𝗴 𝗿𝗲𝗮𝗹 𝗮𝗯𝗼𝘂𝘁 𝗵𝗼𝘄 𝗺𝗮𝗿𝗸𝗲𝘁𝘀 𝘄𝗼𝗿𝗸 𝗮𝘁 𝗮 𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗮𝗹 𝗹𝗲𝘃𝗲𝗹." He called it "the most interesting market simulation paper I've seen in a while. But it's a long way from a trading desk." Paper 𝘛𝘳𝘢𝘥𝘦𝘍𝘔: 𝘈 𝘎𝘦𝘯𝘦𝘳𝘢𝘵𝘪𝘷𝘦 𝘍𝘰𝘶𝘯𝘥𝘢𝘵𝘪𝘰𝘯 𝘔𝘰𝘥𝘦𝘭 𝘧𝘰𝘳 𝘛𝘳𝘢𝘥𝘦-𝘧𝘭𝘰𝘸 𝘢𝘯𝘥 𝘔𝘢𝘳𝘬𝘦𝘵 𝘔𝘪𝘤𝘳𝘰𝘴𝘁𝘳𝘶𝘤𝘵𝘶𝘳𝘦 Authors Maxime Kawawa-Beaudan, Srijan Sood, Kassiani Papasotiriou, Daniel Borrajo, Manuela Veloso If you want to hear how investors, quants, and analysts are using AI on Wall Street, check out my newsletter AI Street. Full write-up in the first comment.
-
Forecasting is no longer a spreadsheet exercise. It’s an intelligence engine. If I were building a forecasting system from scratch in 2025, here’s what it would look like. 1️⃣ Phase 1: Ditch the backward-looking model. Traditional forecasts rely too heavily on rep inputs and lagging indicators. Instead: Feed the model real behavior data: emails, calls, meetings, time in stage, intent signals. Let AI surface deal velocity, risk factors, ghosted accounts, and false positives. 2️⃣ Phase 2: Build the autonomous pipeline. AI isn’t just for scoring. It’s also for triggering. Create Auto-alerts for stalled deals and agent-driven nudges: “Reach out now, buying signals just spiked.” Build auto-prioritization of deals based on historical conversion patterns and AI sentiment analysis. 3️⃣ Phase 3: Deploy next-best-action agents. This is where it gets fun. SDRs and AEs don’t log in to CRMs, they work out of an AI inbox. Every morning: “Here are your top 5 accounts. Here’s what to say. Here’s the play.” GTM motion becomes reactive → proactive → predictive. 4️⃣ Phase 4: Make forecasting a team sport. Sales leaders aren’t spending hours cleaning rollups, they’re challenging the model: “Why did we lose that deal?” “What changed in this region’s pipeline this week?” And AI answers with data, not guesses. Ok, this wasn’t meant to be a product pitch, but you can do all of this with ZoomInfo’s AI Copilot. If your forecast still starts with a spreadsheet and ends with hope, it’s time to rethink the system. What’s the most useful AI signal you’ve seen in a pipeline? #RevOps
-
📈The Power of ChatGPT in Stock Market Predictions 🔍 New research at the University of Florida delves into the fascinating world of Large Language Models (LLMs) like ChatGPT and their emerging capacity to predict stock market returns based on news analysis. 🚀 Key Findings: 🔎 Significant Correlation: ChatGPT categorizes news as positive, negative, or neutral for stock prices, showing a significant correlation with subsequent daily stock returns, outperforming traditional methods. 📊 Superior Performance: Advanced capabilities of ChatGPT, particularly in its latest versions, deliver higher Sharpe ratios, indicating better risk-adjusted returns compared to simpler models like GPT-1 and BERT. 🌐 Applicability Across Market Cap: The predictability of ChatGPT scores is evident in both small and large-cap stocks. Notably, it's more pronounced in smaller stocks and those with negative news, suggesting an underreaction in the market to company news. 🧠 Sophisticated Reasoning Skills: ChatGPT's ability to comprehend nuanced language and contextual meanings enables it to extract valuable signals for stock predictions, even without direct finance training. 📝 New Evaluation Method: The researchers propose a novel approach to evaluate and understand the reasoning capabilities of these models, which can influence regulatory oversight and promote market fairness. 🏦 Implications for the Financial Industry: 💡 Shift in Prediction Methods: The findings could lead to a transformation in market prediction and investment decision-making. 💼 Beneficial for Asset Managers: Providing empirical evidence of LLMs' efficacy in stock market predictions, this insight can guide investment strategies and reduce dependence on traditional analysis methods. 🌍 Contribution to AI in Finance: This research advances the understanding of LLMs in the financial domain, encouraging the development of more sophisticated models tailored for the industry. 🌟 Conclusion: The study highlights the immense potential of ChatGPT and similar models in financial economics, opening new avenues for AI-driven finance and decision-making. #ArtificialIntelligence #Finance #StockMarket #ChatGPT #InvestmentStrategy #FinancialAnalysis #Innovation
-
Most data science teams are using the wrong forecasting model. Over the last few years, I've seen teams blindly throw ARIMA, Prophet, or LSTMs at every forecasting problem… and then wonder why their "advanced" models still miss targets. So I broke forecasting down into 10 models and when each one actually shines in industry: PS, had these notes written from a medium article i read a couple of months back , I’ll link the article once i find it , the article was very detailed and easy to understand and included code snippets :) 1️⃣ ARIMA / SARIMA – The OG workhorse Best for: Stable, well-behaved time series in mature industries (retail, energy). Fails when: The world suddenly changes (pandemics, policy shocks, black swan events). 2️⃣ ETS (Exponential Smoothing) – Simplicity > complexity Best for: High-frequency operational data (daily sales, inventory). Why it wins: Fast to retrain, often beats "fancy" models for short-term horizons. 3️⃣ XGBoost + LSTMs – The hybrid powerhouse This is where the magic happens for E-commerce. While XGBoost handles external signals (promotions/price), LSTMs "remember" the sequence of events. Together, they capture the chaos traditional stats miss. 4️⃣ Prophet – Shipping > theory Best for: Teams without deep ML expertise who still need reasonable business forecasts. Magic: Handles multiple seasonalities + holidays with sane defaults. 5️⃣ Monte Carlo Simulation – Forecasting risk, not just a number Best for: Revenue / capacity planning in high-uncertainty environments. Use it when: A single point forecast is dangerous; you care about probabilities and worst-case scenarios. 6️⃣ Market Mix Modeling (MMM) – Where did the money actually work? Best for: Large marketing budgets across TV, digital, offline. Outcome: Quantifies which channels really drive revenue so you can move budget with confidence. 7️⃣ Bass Diffusion – New product launches Best for: Predicting adoption curves for new products, features, or markets. Why it's powerful: Separates innovation (marketing push) from imitation (word‑of‑mouth). 8️⃣ ARIMAX / Dynamic Regression – When context matters Dynamic regression extends traditional time series models (like ARIMA) by incorporating external predictors, such as weather, promotions, or economic indicators, to explain demand fluctuations. It's ideal when trends alone can't capture reality. 9️⃣ Causal Impact (Bayesian Structural Time-Series) – Proving interventions worked Causal Impact estimates the effect of an intervention or event by comparing actual outcomes to a "counterfactual" scenario—a parallel universe where the event didn't occur. Perfect for campaigns, product launches, or policy changes. 🔟 Ensemble Methods – When you can't pick just one Combine multiple models (ARIMA + XGBoost + Prophet) and let them vote. Often beats any single model, especially when patterns shift unexpectedly. PS: Photo generated with AI #datascience #forecasting #timeseries #machinelearning
-
Predicting the next in tech is just pattern recognition. My team and I ‘predicted’ agents, ChatGPT apps, and memory systems before they happened, back in 2023. But really, the pattern was all too obvious. Foresight helped us stay ahead: we built one of the first travel bots, were launch partners for GPT Apps, and already have agentic use cases live in production with great customer metrics. Here’s how to do it 👇 1️⃣ Follow the failures Every breakthrough begins where the current experience breaks. LLMs could reason and write, but couldn’t act and couldn’t remember. This restricted their utility and created a bad experience. That gap created tools and memory, and the combination created agents. Failures in production always attract the fastest investment, because that’s where money bleeds. 2️⃣ Follow the money Technology follows incentives. LLM companies have runway, but not infinite. They need to monetize. Choices are B2B and B2C. This gave us agent kits, enterprise versions, and most recently, App stores. Advertising and rev-share are the easiest levers to pull next. 3️⃣ Follow the friction The world shifts when something hard becomes easy, or something easy becomes hard again. Easier to build → micro-SaaS boom. Easier to productize knowledge → consulting slowdown. 4️⃣ Follow the talent Talent moves before markets do. Watch who’s hiring whom, and for what. When researchers leave frontier labs for startups, or when companies start hiring monetization and growth experts, it signals a strategic shift. 5️⃣ Follow the discourse The tone of debate shapes the pace of adoption. When safety and security dominate headlines, policy will slow innovation. When sentiment swings back to capability and value, acceleration returns. The future doesn’t arrive suddenly. It leaks through failure, funding, friction, talent, and talk. The trick is learning to listen early.
-
Everyone is talking about fully autonomous "Agentic AI," but let’s be real—in an enterprise environment, 100% LLM autonomy is a massive liability. Generative AI is incredibly powerful, but its unreliability and tendency to go off the rails remain its Achilles heel. So, how are companies actually deploying AI safely at scale? They are quietly pivoting to Hybrid AI. Instead of relying solely on an LLM, leaders like Twilio, Salesforce, and Instacart are pairing Generative AI with traditional Predictive AI to act as a crucial safety net. Here is how the architecture works in practice: 1️⃣ The LLM Generates: The AI drafts a response or decides on a proposed action. 2️⃣ The Predictive Model Scores: A separate ML model evaluates that specific draft and assigns a real-time risk score (e.g., assessing the likelihood of an incorrect price, a hallucination, or a policy violation). 3️⃣ The Routing Decision: If the risk score is low, the AI executes autonomously. If the risk is high, it triggers a "human-in-the-loop" workflow for review. Accepting human intervention for the riskiest edge cases is the only way businesses can confidently automate the rest. We get to eat our cake, and keep our systems secure, too. Are you seeing this shift toward hybrid predictive/generative models in your industry yet? Let me know what you think below! 👇 #HybridAI #EnterpriseAI #PredictiveAnalytics #GenAI
-
Let's face it. Your monthly forecast accuracy is probably stuck at 70%. 📊 Maybe 75% on a good month. And that missing 25-30%? That's millions in working capital tied up in "just in case" inventory. 💸 Here's what nobody talks about: High-tech manufacturers aren't just bad at forecasting. They're bad at the SAME things, month after month: • Component lead times that shift like sand ⏳ • Demand spikes that "nobody saw coming" (except they follow patterns) 📈 • Supply chain disruptions treated as "random" (they're not) 🚚 I recently saw a semiconductor manufacturer discover their "unpredictable" demand spikes actually correlated with competitor factory shutdowns. Their ML model caught it. Their spreadsheets never did. 🤖 Oracle EPM's Predictive Planning doesn't just run basic time-series forecasts. It runs 14 different algorithms simultaneously - ARIMA, Holt-Winters, exponential smoothing - then automatically selects the winner based on lowest error rates. 🎯 One electronics manufacturer improved forecast accuracy from 72% to 88% in 6 months. The result? $12M reduction in safety stock. $4M less in expedited shipping. ✅ But here's the kicker: The ML models get SMARTER over time. They learn your seasonality patterns, identify leading indicators you missed, and adjust for market anomalies automatically. 🧠 No more "We've always added 20% buffer." No more finger-in-the-air forecasting. 🎲 Want to see exactly how this works for high-tech manufacturing? Oracle just released their Predictive Planning Guide specifically for complex supply chains: https://lnkd.in/g3TxpB73 📘 Stop letting forecast inaccuracy eat your margins. The math works. The question is: when will you? ⏰ #CFO #FPandA #ManufacturingFinance #OracleEPM #PredictivePlanning