Skip to Main Content
Talk Beginner BSD-3-Clause License First Talk

Real-Time Video Pipelines on Embedded SoCs: A FreeRTOS Case Study

Proposal status is Approved
Session Description

Integrating camera capture and display subsystems on embedded SoCs presents significant software design challenges due to competing buffer ownership models across independent hardware subsystems. This talk presents a practical implementation of a zero-copy video pipeline on a TI Jacinto SoCs running FreeRTOS, coordinating three drivers: a CSI2-DPHY receiver, a UDMA engine, and a Display Subsystem driver.

The implementation uses FVID2, TI's unified video interface, to apply a consistent queue/dequeue buffer model to both capture and display operations. We examine the initialization sequence where the application transfers UDMA ownership to the CSIRX driver, enabling the DSS driver direct visibility into captured buffers.

Critical gaps in single-task designs are identified, specifically the absence of mechanisms preventing capture from overwriting buffers during display scanout. We present a corrected two-task producer-consumer design using counting semaphores to enforce mutual exclusion, with explicit analysis of task priorities and frame timing implications.

This work bridges the gap between pipelines that function nominally and those structured to remain correct under timing pressure, illustrating the complexity beneath seemingly solved problems in embedded systems integration.

Key Takeaways
  1. How FVID2's queue/dequeue model provides a unified buffer-ownership interface across CSIRX and DSS drivers

  2. What a proper FreeRTOS producer-consumer pipeline for this use case would look like

References

Session Categories

Technology architecture
Talk License: BSD-3-Clause License

Which track are you applying for?

Real Time Operating Systems (RTOS)

Speakers

Hariesh Varshan Embedded Software Engineer | Texas Instruments India Pvt Ltd

Avid learner who loves to explore everything embedded on and off work. I do run and gym as I strongly believe movement is my way of living.

Hariesh Varshan
https://www.linkedin.com/in/hariesh-varshan