(+351) 21 24 10006  ·  info@bconcepts.pt
Carnaxide, Lisbon
Feature stores: organize features for production AI
Data Engineering

Feature stores: organize features for production AI

João Barros 16/07/2026 9 min

"Without consistent features, the best AI in the world becomes guesswork."

What is a feature store?

A feature store is a centralized repository to store, serve, and manage features — the variables, aggregations, and transformations used by machine learning models. It is not just a database: it is a convergence point between data engineering, data scientists, and production operations. Beyond storing values, a feature store documents definitions, maintains versions, ensures that transformations applied during training are identical to those applied at inference, and exposes APIs to retrieve features in real time or in batch.

Feature stores: organize features for production AI

In practice, the feature store solves routine problems that consume time and introduce risk: divergence between training and production data, duplication of transformation logic across teams, and latency in making features available. By centralizing these functions, an organization turns ad‑hoc code into reusable functions, reducing the likelihood of subtle bugs that only appear after deployment.

Imagine a company with 20 models in production: without a feature store it is common to find 3–4 different versions of the same metric (for example '30‑day purchase frequency') implemented by different teams. This translates into uncertainty, more complex testing, and high maintenance costs. A feature store reduces that variability and promotes transparency — each feature has a canonical definition, an owner, and a change history.

Why do you need it now?

Models stop being interesting when they fail at scale. Feature inconsistency is one of the main causes of model degradation in production: a small difference in a time window, in null value handling, or in an aggregation can introduce bias or data leakage. These problems are often imperceptible during offline validation, but make models unpredictable in real environments.

As the number of models and teams grows, these problems amplify. A signal transformed differently by two teams gives rise to two versions of the same indicator, and confidence in predictions falls. In addition, every team that reimplements the same transformations is wasting cumulative effort: adding engineering hours, the cost becomes significant. Mature teams report reductions of 30–60% in engineering time per new model when using a feature store — a difference that, over a year, can amount to hundreds of thousands of euros in saved salaries and accelerated innovation.

There are also concrete operational gains: consistency reduces regressions after deploy and decreases diagnosis time when something goes wrong. A simple policy, like ensuring that all critical features have regression tests and automated schema checks, can reduce production incidents by 40–70% according to market experience.

Architecture and key components

A typical feature store has three fundamental layers: batch storage, online storage, and a transformation engine. Batch storage holds aggregated features for training and retraining, typically partitioned by date or entity, and is optimized for throughput. Online storage serves low‑latency values for inference in production, with P99 requirements often below 20–50 ms, depending on the use case. The transformation engine is responsible for computing features consistently, whether in stream, batch, or on‑demand mode, and for ensuring the same logic is reusable across modes.

Beyond these, there are other essential components: a feature catalog with metadata (definitions, owners, validity, version), validation and testing mechanisms (for example, schema checks, distribution validation, and data leakage tests), and access APIs for data scientists and inference services. Without these components, the feature store is reduced to a collection of files — useful, but without the guarantees organizations require in production.

More concretely, a typical implementation includes: declarative pipelines to compute features (e.g., reusable code that can run on Spark, Flink, or serverless jobs), a historical store to enable reconstruction of training datasets without data leakage, inline caches to accelerate access to low‑latency features, and integrations with authentication and audit systems to meet privacy and compliance requirements. For organizations with very low latency requirements, it is common to place a cache in distributed memory (e.g., Redis or memcached) with TTLs adapted to the freshness required.

Challenges and common mistakes

A recurring mistake is treating the feature store as "an infra project" isolated, instead of viewing it as a data product. This leads to lack of adoption: without clearly defining users, SLAs, and responsibilities, the platform is underutilized and duplicate features and obsolete documentation accumulate. Success also depends on governance — knowing who approves a change to a critical feature and how impacts are measured.

Another frequent problem is attempting to build everything in‑house without evaluating the total cost of ownership. Managing latency, consistency, security, and monitoring is not trivial and can consume entire teams. Many organizations underestimate the ongoing effort: compatibility updates, query optimizations, infrastructure upgrades, and support for new use cases. A practical rule: if you expect more than 10–20 features served in tens of thousands of requests per second, it is worth doing a detailed cost and risk analysis before choosing to build from scratch.

It is also common to underestimate integration with existing pipelines. Providing an online endpoint that responds in milliseconds requires integration with caches, authentication points, rate limits, and monitoring. Without these integrations, feature latency can make the service useless for real‑time use cases. Finally, the lack of observability metrics — such as distribution drift, increases in null values, or increases in P95/P99 latencies — is another key cause of operational failures.

Mini case study: e‑commerce increases conversions with consistent features

Context: an online retailer with 18 million monthly visits and a catalog of 250k SKUs had several recommendation, dynamic pricing, and fraud prevention models. Each team calculated user behavior features differently — inconsistent time windows, aggregations with varied timezones, and event counting with redundant logic.

Intervention: implementation of a feature store over three months. The project centralized 42 critical features, including 7‑ and 30‑day purchase frequency, average cart value by channel, recency weighted by category, and bounce rate by device. A catalog was created with owners and definitions, a review process for changes, and an online endpoint with average latency of 8 ms capable of serving 1,500 requests/s with peaks up to 4,500 req/s using a set of caches and regional replicas.

Measurable results after 6 months:

  • Time to production: 45% reduction (from 20 to 11 days per model), due to reuse of tested features and clear documentation.
  • Recommendation model accuracy (MRR): 12% relative increase, resulting in a 6% uplift in conversions from cross‑sell campaigns, translating to about €420k/year of incremental revenue for that business line.
  • Fraud prevention: false positive rate reduced by 28%, enabling a reduction in manual reviews and operating costs estimated at €120k/year.
  • Reduction in processing duplication: estimated savings of €85k/year in compute and engineering costs, with project ROI achieved in the first year.

This case illustrates that the benefits are a combination of technical gains (latency, consistency, scalability) and direct business impact (more sales, lower costs). The organization also gained agility: new personalization models began to be experimented with iterations of 1–2 weeks instead of 3–4 weeks.

A well‑designed feature store is not a luxury; it is the piece that turns ML prototypes into predictable and measurable services.

How to choose between build or buy

The decision between building in‑house or adopting a commercial solution depends on the organization’s maturity, the volume of models, and available skills. Small teams with few models can initially benefit from a simple approach — a catalog and shared pipelines. However, above 5–10 models in production, maintenance costs and inconsistency risks increase rapidly, making a dedicated solution more attractive.

When evaluating commercial solutions, consider several factors: compatibility with existing architecture (cloud, on‑premises, or hybrid), support for batch and streaming processing, online service latency and ability to scale for peaks, data security and governance (including access policies and auditing), and monitoring and alerting capabilities. Run proofs of concept with representative loads: testing with 1k–10k requests/s and historical datasets is more realistic than just a prototype in a development environment.

Also evaluate recurring costs versus initial development costs. A managed solution can cost 20–40% of the cost of building in‑house in the first 2–3 years when including infrastructure, salaries, and ongoing support. Finally, consider the ecosystem: integration with experimentation tools, CI/CD pipelines, and observability platforms reduces time to value.

How to start: 6‑month roadmap

We suggest a pragmatic roadmap in three phases for the first six months, with clear deliverables and success metrics.

Phase 1 (1–6 weeks): inventory and definition. Catalog existing features, identify 10–15 critical features with the highest impact on business metrics (for example, conversions, churn, fraud) and name owners for each feature. Define latency SLAs and data freshness requirements (e.g., 5‑minute freshness for session features, daily for historical aggregates) and success metrics (reduced deployment time, decreased false positives).

Phase 2 (6–14 weeks): minimum viable implementation. Implement pipelines to compute and validate the 10–15 selected features, create batch storage and a simple online endpoint, and integrate the most urgent models. Automate data quality checks and regression tests for each feature (for example, alerts if the mean changes more than 20% relative to history). Validate performance with representative loads and define SLA thresholds.

Phase 3 (14–26 weeks): stabilization and expansion. Expand the catalog, optimize online storage with caching and sharding as needed, integrate feature performance monitoring (distribution drift, percentage of null values, P50/P95/P99 latencies) and formalize governance processes. Introduce change review, semantic versioning of features, and rollback playbooks. After six months, the organization should have a reusable foundation to accelerate new models and a repeatable production deployment process.

In summary

  • A feature store ensures consistency between training and inference, reducing errors and loss of confidence in models.
  • The gains are technical and economic: less duplicated work, faster production deployment, and measurable business impact.
  • Start small, assign owners and SLAs, and evolve with clear success metrics.
  • The build vs. buy choice depends on scale: above 5–10 models in production, dedicated solutions tend to be more cost‑effective.

Conclusion and next steps

A feature store is an investment in predictability. It does not solve all AI problems, but it addresses one of the biggest failure points: inconsistency and rework in features. For many decision makers, the right question is no longer “do we have models?” but “are our models sustainable?” — and the answer lies in adopting well‑defined feature engineering practices and instituting clear governance.

Concrete next steps: 1) inventory the 15 features with the highest business impact; 2) define for each the source, update frequency, owner, and quality thresholds; 3) prove a prototype that serves those features with latency below 20 ms in online scenarios; 4) measure development time and impact on business metrics before and after centralization.

Shall we get to practice? Which critical feature in your organization would make sense to centralize first?

← Back to insights
Let's talk?

Ready to transform your data?

Book a free 30-minute meeting and find out how we can help your team make better decisions.

Book a Free Meeting
bConcepts