Tag Archives: Flash Storage

NAB 2019: Storage for M&E workflows

By Tom Coughlin

Storage is a vital element in modern post production, since that’s where the video content lives. Let’s look at trends in media post production storage and products shown at the 2019 NAB show. First let’s look at general post production storage architectures and storage trends.

My company produces the yearly “Digital Storage in Media and Entertainment Report,” so we are keeping an eye on storage all year round. The image to the right is a schematic from our 2018 report — it’s a nonlinear editing station showing  optional connections to shared online (or realtime) storage via a SAN or NAS (or even a cloud-based object storage system) and a host bus adapter (HBA or xGbE card). I hope this gives you some good background for what’s to come.

Our 2018 report also includes data from our annual Digital Storage in Media and Entertainment Professional Survey. The report shows that storage capacity annual demand is expected to be over 110 Exabytes of storage by 2023. In 2018 48% of responding survey participants said that they used cloud-based storage for editing and post production. And 56% also said that they have 1TB or more storage capacity in the cloud. In 2018, Internet distribution was the most popular way to view proxies.

All of this proves that M&E pros will continue to use multiple types of digital storage to enable their workflows, with significant growth in the use of cloud storage for collaborative and field projects. With that in mind, let’s dig into some of the storage offerings that were on display at NAB 2019.

Workflow Storage
Dell Technologies said that significant developments in its work with VMware unlock the value of virtualization for applications and tools to automate many critical M&E workflows and operations. Dell EMC and VMware said that they are about to unveil the recipe book for making virtualization a reality for the M&E industry.

Qumulo announced an expansion of its cloud-native file storage offerings. The company introduced two new products —CloudStudio and CloudContinuity — as well as support for Qumulo’s cloud-native, distributed hybrid file system on the Google Cloud Platform (GCP). Qumulo has partnered with Google to support Qumulo’s hybrid cloud file system on GCP and on the Google Cloud Platform Marketplace. Enterprises will be able to take advantage of the elastic compute resources, operational agility, and advanced services that Google’s public cloud offers. With the addition of the Google Cloud Platform, Qumulo is able to provide multi-cloud platform support, making it easy for users to store, manage and access their data, workloads and applications in both Amazon Web Services (AWS) and GCP. Qumulo also enables data replication between clouds for migration or multi-copy requirements.

M&E companies of any size can scale production into the public cloud with CloudStudio, which securely moves traditionally on-prem workspaces, including desktops, applications and data, to the public cloud on both the AWS and GCP platforms. Qumulo’s file storage software is the same whether on-prem or in the cloud, making the transition seamless and easy and eliminating the need to reconfigure applications or retrain users.

CloudContinuity enables users to automatically replicate their data from an on-prem Qumulo cluster to a Qumulo instance running in the cloud. Should a primary on-prem storage system experience a catastrophic failure, customers can redirect users and applications to the Qumulo cloud, where they will have access to all of their data immediately. CloudContinuity also enables quick, automated fail-back to an on-prem cluster in disaster recovery scenarios.

Quantum announced its VS-Series, designed for surveillance and industrial IoT applications. The VS-Series is available in a broad range of server choices, suitable for deployments with fewer than 10 cameras up to the largest environments with thousands of cameras. Using the VS-Series, security pros can efficiently record and store surveillance footage and run an entire security infrastructure on a single platform.

Quantum’s VS-Series architecture is based on the Quantum Cloud Storage Platform (CSP), a new software-defined storage platform specifically designed for storing machine and sensor-generated data. Like storage technologies used in the cloud, the Quantum CSP is software-defined and can be deployed on bare metal, as a virtual machine, or as part of a hyperconverged infrastructure.Unlike other software-defined storage technologies, the Quantum CSP was designed specifically for video and other forms of high-resolution content — engineered for extremely low latency, maximizing the streaming performance of large files to storage.

The Quantum Cloud Storage Platform allows high-speed video recording with optimal camera density and can host and run certified VMS management applications, recording servers and other building control servers on a single platform.

Quantum say that the VS-Series product line is being offered in a variety of deployment options, including software-only, mini-tower and 1U, 2U and 4U hyperconverged servers.

Key VS-Series attributes:
– Supports high camera density and software architecture that enables users to run their entire security infrastructure on a single hyperconverged platform.
– Offers a software-defined platform with the broadest range of deployment options. Many appliances can scale out for more cameras or scale up for increased retention.
– Comes pre-installed with certified VMS applications and can be installed and configured in minutes.
– Offers a fault-tolerant design to minimize hardware and software issues, which is meant to virtually eliminate downtime

Quantum was also showing its R-3000 at NAB. This box was designed for in-vehicle data capture for developing driver assistance and autonomous driving systems. This NAS box includes storage modules of 60TB with HDDs and 23TB or 46TB using SSDs. It works off 12 volt power and features two 10 GbE ports.

Arrow Distribution bundled NetApp storage appliances with Axle AI software. The three solutions offered are the VM100, VM200 and VM400 with 100TB, 200TB and 400TB, respectively, with 10GbE network interfaces and NetApp’s FAS architecture. Each configuration also includes an Intel-based application server running a five-user version of Axle AI 2019. The software includes a browser front-end that allows multiple users to tag, catalog and search their media files, as well as a range of AI-driven options for automatically cataloging and discovering specific visual and audio attributes within those files.

Avid Nexis|Cloudspaces

Avid Nexis|Cloudspaces is a storage as a service (SaaS) offering for post, news and sports teams, enabling them to store and park media and projects not currently in production in the cloud, leveraging Microsoft Azure. This frees up local Nexis storage space for production work. The company is offering all Avid Nexis users a limited-time free offer of 2TB of Microsoft Azure storage that is auto-provisioned for easy setup and can scale as needed. Avid Nexis manages these Cloudspaces alongside local workspaces, allowing unified content management.

DDP was showing a rack with hybrid SSD/HDD storage that the company says provides 24/7 365 days of reliable operation with zero interruptions and a transparent failover setup. DDP has redesigned its GUI to provide faster operation and easier use.

Facilis displayed its new Hub shared storage line developed specifically for media production workflows. Built as an entirely new platform, Facilis Hub represents the evolution of the Facilis shared file system with the block-level virtualization and multi-connectivity performance required in shared creative environments. This solution offers both block-mode Fibre Channel and Ethernet connectivity simultaneously, allowing connection through either method with the same permissions, user accounts and desktop appearance.

Facilis’ Object Cloud is an integrated disk-caching system for cloud and LTO backup and archive that includes up to 100TB of cloud storage for one low yearly cost. A native Facilis virtual volume can display cloud, tape and spinning disk data in the same directory structure, on the client desktop. Every Facilis Hub shared storage server comes with unlimited seats of the Facilis FastTracker asset tracking application. The Object Cloud software and storage package is available for most Facilis servers running version 7.2 or higher.

Facilis also had particular product updates. The Facilis 8 has 1GB/s data rates through standard dual-port 10GbE and options for 40GbE and Fibre Channel connectivity with 32TB, 48TB and 64TB capacities. The Facilis Hub 16 model offers 2GB/s speed with 16 HDDs with 64TB, 96TB and 128TB capacities. The company’s Hub Hybrid 16 model and SSD offers SSDs in an integrated high-capacity HDD-based storage system offering performance of 3GB/s and 4GB/s. With two or more Hub 16 or Hub 32 servers attached through 32Gb Fibre Channel controllers, Facilis Hub One configurations can be fully redundant, with multi-server bandwidth aggregated into a single point of network connectivity. The Hub One starts at 128GB and scales to 1PB.

Pixit Media announced the launch of PixStor 5, the latest version of its leading scale-out data-driven storage platform. According to the company, “PixStor 5 is an enterprise-class scale-out NAS platform delivering guaranteed 99% performance for all types of workflow and a single global namespace across multiple storage tiers — from on-prem for the cloud.”

New PixStor 5 highlights include:

PixStor 5

– Secure container services – This new feature offers multi-tenancy from a single storage fabric. PixStor 5 enables creative studios to deploy secure media environments without crippling productivity and creativity and aligns with TPN security accreditation standards to attract A-list clients.
– Cloud workflow flexibility — PixStor 5 expands your workflows cost-effectively into the cloud with fully automated seamless deployment to cloud marketplaces, enabling hybrid workflows for burst render and cloud-first workflows for global collaboration. PixStor 5 will soon be available in the Google Cloud Platform Marketplace, followed shortly by AWS and Azure.
– Enhanced search capabilities — Using machine learning and artificial intelligence cloud-based tools to drive powerful media indexing and search capabilities, users can perform fast, easy and accurate content searches across their entire global namespace.
– Deep granular analytics – With single-pane-of-glass management and user-friendly dashboards, PixStor 5 allows a holistic view of the entire filesystem and delivers business-relevant metrics to reinforce storage strategies.

GB Labs launched new software, features and updates to its FastNAS and Space, Echo and Vault ranges at NAB. The Space, Echo and Vault ranges got intelligent new software features, including the Mosaic asset organizer and the latest Analytics Center, along with brand-new Core.4 and Core.4 Lite software. The new Core software is also now included in the FastNAS product range.

GB Labs

Mosaic software, which already features on the FastNAS, range, could be compared to a MAM.  It is an asset organizer that can automatically scour all in-built metadata and integrate with AI tagging systems to give users the power to find what they’re looking for without having to manually enter any metadata.

Analytics Center will give users the visibility into their network so that they can see how they’re using their data, giving them a better understanding of individual or system-wide use, with suggestions on how to optimize their systems much more quickly and at a lower cost.

The new Core.4 software for both ranges builds on GB Labs’ current Core.3 OS offering a high-performance custom OS that is specifically used to serve media files. It allows a stable performance for every user and the best from the least amount of disk, which saves power.

EditShare’s flagship EditShare EFS scale-out storage enterprise scale-out storage solution was on display. It was developed for large-scale media organizations and supports hundreds of users simultaneously, with embedded tools for sharing media and collaborating across departments, across sites and around the world.

EditShare was showcasing advancements in its EFS File Auditing technology, the industry’s only realtime auditing platform designed to manage, monitor and secure your media from inception to delivery. EFS File Auditing keeps track of all digital assets and captures every digital footprint that a file takes throughout its life cycle, including copying, modifying and deleting of any content within a project.

Storbyte introduced its eco-friendly SBJ-496 at the 2019 NAB show. According to the company, this product is a new design in high-capacity disk systems for long-term management of digital media content with enterprise-class availability and data services. Ideal for large archive libraries, the SBJ-496 requires little to no electricity to maintain data, and its environmentally friendly green design allows unrestricted air flow, generates minimal heat and saves on cooling expenses.

Echo Flash

The new EcoFlash SBS-448, for digital content creation and streaming, is an efficient solid-state storage array that can deliver over 20GB of data per second. EcoFlash SBS-448 consumes less than half the electrical power and produces a lot less heat. Its patented design extends its lifespan significantly, resulting in a total operating cost per terabyte that is 300-500% lower.

NGD Systems was showing its computational storage product with several system partners at NAB, including at the Echostreams booth for its 1U platforms. NGD said that its M.2 and upcoming EDSFF form factors can be used in dense and performance-optimized solutions within the EchoStreams 1U server and canister system. In addition to providing data analytics and realtime analysis capture, the combination of NGD Systems products and EchoStreams 1U platforms allow for deployment at the extreme edge for use in onsite video acquisition and post processing at the edge.

OpenDrives was showcasing its Atlas software platform and product family of shared storage solutions. Its NAB demo was built on a single Summit system, including the OmniDrive media accelerator, powered by NVMe, to significantly boosts editorial, transcoding, color grading and visual effects shared workflows. OpenDrives is moving to a 2U form factor in its manufacturing, streamlining systems without sacrificing performance.

iX Systems said that their TrueNAS enterprise storage appliances deliver a perfect range of features and scalability for next-gen M&E workflows. AIC had an exhibit showing several enterprise storage systems, including some with NGD Systems computational storage SSDs. Promise Technology said that its VTrak NAS has been optimized for video application environments. Sony was offering PCIe SSD data storage servers. Other companies showing workflow storage products included Asustor, elements, PAC Storage and Rocstor.

Conclusions
The media and entertainment industry has unique requirements for storage to support modern digital workflows. A number of large and small companies have come up with a variety of local and cloud-based approaches to provide storage for post production applications. The NAB show is one of the world’s largest forums for such products and a great place to learn about what the digital storage and memory industry has to offer media and entertainment professionals.


Tom Coughlin, president of Coughlin Associates, is a digital storage analyst and business/technology consultant. He is active with SMPTE, SNIA, the IEEE — he is president of IEEE-USA and active in the CES, where he is chairman of the Future Directions Committee) and other pro organizations. 

DigitalGlue’s Creative.Space intros all-Flash 1RU OPMS storage

Creative.Space, a division of DigitalGlue that provides on-premise managed storage (OPMS) as a service for production and post companies as well as broadcast networks, has added the Breathless system to its offerings. The product will make its debut at Cine Gear in LA next month.

The Breathless Next Generation Small Form Factor (NGSFF) media storage system offers 36 front-serviceable NVMe SSD bays in 1RU. It is designed for 4K, 6K and 8K uncompressed workflows using JPEG2000, DPX and multi-channel OpenEXR. There are 4TB of NVMe SSDs currently available, but a 16TB version will be available in later this year, allowing 576TB of Flash storage to fit in 1RU. Breathless performs 10 million random read IOPS (Input/Output Operations per Second) of storage performance (up to 475,000 per drive).

Each of the 36 NGSFF SSD bays connects to the motherboard directly over PCIe to deliver maximum potential performance. With dual Intel Skylake-SP CPUs and 24 DDR4 DIMMs of memory, this system is perfect for I/O intensive local workloads, not just for high-end VFX, but also realtime analytics, database and OTT content delivery servers.

Breathless’ OPMS features 24/7 monitoring, technical support and next-day repairs for an all-inclusive, affordable fixed monthly rate of $2,495.00, based on a three-year contract (16TB of SSD).

Breathless is the second Creative.Space system to launch, joining Auteur, which offers 120TB RAW capacity across 12 drives in a 24-bay 4 RU chassis. Every system is custom-built to address each client’s needs. Entry level systems are designed for small to medium workgroups using compressed 4K, 6K and 8K workflows and can scale for 4K uncompressed workflows (including 4K OpenEXR) and large multi-user environments.

DigitalGlue, an equipment, integration and software development provider, also designs and implements turnkey solutions for content creation, post and distribution.

 

High-performance flash storage at NAB 2018

By Tom Coughlin

After years of watching the development of flash memory-based storage for media and entertainment applications, especially for post, it finally appears that these products are getting some traction. This is driven by the decreasing cost of flash memory and also the increase in 4K up to 16K workflows with high frame rates and multi-camera video projects. The performance demanded for working storage to support multiple UHD raw video streams makes high performance storage attractive. Examples of 8K workflows were everywhere at the 2018 NAB show.

Flash memory is the clear leader in professional video camera media, increasing from 19% in 2009 to 66% in 2015, 54% in 2016 and 59% in 2017. The 2017 media and entertainment professional survey results are shown below.

Flash memory capacity used in M&E applications is believed to have been about 3.1% in 2016, but will be larger in coming years. Overall, revenues for flash memory in M&E should increase by more than 50% in the next few years as flash prices go down and it becomes a more standard primary storage for many applications.

At the 2018 NAB Show, and the NAB ShowStoppers, there were several products geared for this market and in discussion with vendors it appears that there is some real traction for solid state memory for some post applications, in addition to cameras and content distribution. This includes solid-state storage systems built with SAS, SATA and the newer NVMe interface. Let’s look at some of these products and developments.

Flash-Based Storage Systems
Excelero reports that its NVMe software-defined block storage solution with its low-latency and high-bandwidth improves the interactive editing process and enables customers to stream high-resolution video without dropping frames. Technicolor has said that it achieved 99.8% of local NVMe storage server performance across the network in an initial use of Excelero’s NVMesh. Below is the layout of the Pixit Media Excelero demonstration for 8K+ workflows at the NAB show.

“The IT infrastructure required to feed dozens of workstations of 4K files at 24ps is mindboggling — and that doesn’t even consider what storage demands we’ll face with 8K or even 16K formats,” says Amir Bemanian, engineering director at Technicolor. “It’s imperative that we can scale to future film standards today. Now, with innovations like the shared NVMe storage such as Excelero provides, Technicolor can enjoy a hardware-agnostic approach, enabling flexibility for tomorrow while not sacrificing performance.”

Excelero was showcasing 16K post production workflows with the Quantum StorNext storage and data management platform and Intel on the Technicolor project and at Mellanox with its 100Gb Ethernet switch.

Storbyte, a company based in Washington, DC, was showing its Eco Flash servers at the NAB show. Their product featured hot-swappable and accessible flash storage bays and redundant hot-swappable server controllers. The product features the company’s Hydra Dispersed Algorithmic Modeling (HDAM) that allows them to avoid having a flash transition layer, garbage collection, as well as dirty block management resulting in less performance overhead. Their Data Remapping Accelerator Core (DRACO) is said to offer up to a 4X performance increase over conventional flash architectures that can maintain peak performance even at 100% drive capacity and life and thus eliminates a write cliff and other problems that flash memory is subject to.

DDN was showing its ExaScaler DGX solution that combined a DDN ExaScaler ES14KX high-performance all-flash array integrated with a single Nvidia DGX-1 GPU server (initially announced at the 2018 GPU Technology Conference). Performance of the combination achieved up to 33GB/s of throughput. The company was touting this combination to accelerate machine learning, reducing the load times of large datasets to seconds for faster training. According to DDN, the combination also allows massive ingest rates and cost-effective capacity scaling and achieved more than 250,000 random read 4K IOPS. In addition to HDD-based storage, DDN offers hybrid HDD/SSD as well as all-flash array products. The new DDN SFA200NV all-flash platform product was on display at the 2018 NAB show

Dell EMC was showing its Isilon F800 all-flash scale-out NAS for creative applications. According to the company, the Isilon all-flash array gives visual effects artists and editors the power to work with multiple streams of uncompressed, full-aperture 4K material, enabling collaborative, global post and VFX pipelines for episodic and feature projects.

 

Dell EMC said this allows a true scale-out architecture with high concurrency and super-fast all-flash network-attached storage with low latency for high-throughput and random-access workloads. The company was demonstrating 4K editing of uncompressed DPX files with Adobe Premiere using a shared Isilon F800 all-flash array. They were also showing 4K and UHD workflows with Blackmagic’s DaVinci Resolve.

NetApp had a focus on solid-state storage for media workflows in their “Lunch and Learn sessions,” co-hosted by Advanced Systerms Group (ASG). The sessions discussed how NVMe and Storage Class Memory (SCM) are reshaping the storage industry. NetApp provides SSD-based E-series products that are used in the media and entertainment industry.

Promise Technology had its own NVMe SSD-based products. The company had data sheets on two NVMe fabric products. One was an HA storage appliance in a 2RU form factor (NVF-9000) with 24 NVMe drive slots and 100GbE ports offering up to 15M IOPS and 40GB/s throughout and many other enterprise features. The company said that its fabric allows servers to connect to a pool of storage nodes as if they had local NVMe SSDs. Promise’s NVMe Intelligent Storage is a 1U appliance (NVF-7000) with multiple 100 GbE connectors offering up to 5M IOPS and 20GB/s throughput. Both products offer RAID redundancy and end-to-end RDMA memory access.

Qumulo was showing its Qumulo P-Series NVMe all-flash solution. The P-series combines Qumulo File Fabric (QF2) software with high-speed NVMe, Intel Skylake SP processors and high-bandwidth Intel SSDs and 100GbE networking. It offers 16GB/s in a minimum four-node configuration (4GB/s per node). The P-series nodes come in 23 and 92TB size. According to Qumulo, QF2 provides realtime visibility and control regardless of the size of the file system, realtime capacity quotas, continuous replication, support for both SMB and NFS protocols, complete programmability with REST API and fast rebuild times. Qumulo says the P-series can run on-premise or in the cloud and can create a data fabric that interconnects every QF2 cluster whether it is all-flash, hybrid SSD/HDD or running on EC2 instances in AWS.

AIC was at the show with its J2024-04 2U 24-bay NVMe all-flash array using a Broadcom PCIe switch. The product includes dual hot-swap redundant 1.3 KW power supplies. AIC was also showing this AFA product providing a Storage Software Fabric platform with EXTEN smart NICs using Broadcom chips to create a storage software fabric platform, as well as an NVMe JBOF.

Companies such as Luma Forge were showing various hierarchical storage options, including flash memory, as shown in the image below.

Some other solid-state products included the use of two SATA SSDs for performance improvements for the SoftIron HyperDrive Ceph-based object storage appliance. Scale Logic has a hybrid SSD SAN/NAS product called Genesis Unlimited, which can support multiple 4K streams with a combination of HDDs and SSDs. Another NVMe offering was the RAIDIX NVMEXP software RAID engine for building NVMe-based arrays offering 4M IOPS and 30GB/s per 1U and offering RAID levels 5, 6 and 7.3. Nexsan has all-flash versions of its Unity storage products. Pure Storage had a small booth in the back of the South Hall lower showing their flash array products. Spectra Logic was showing new developments in its flash-based Black Pearl product, but we will cover that in another blog.

External Flash Storage Products
Other World Computing (OWC) was showing its solid-state and HDD-based products. They had a line-up of Thunderbolt 3 storage products, including the ThunderBlade and the Envoy Pro EX (VE) with Thunderbolt 3. The ThunderBlade uses a combination of M.2 SSDs to achieve transfer speeds up to 2.8 GB/s read and 2.45 GB/s write (pretty symmetrical R/W) with 1TB to 8TB storage capacity. It is fanless and has a dimmable LED so it won’t interfere with production work. OWC’s mobile bus-powered SSD product, Envoy Pro EX (VE) with Thunderbolt 3 provides sustained data rates up to 2.6 GB/s read and 1.6 GB/s write. This small 1TB to 2TB drive can be carried in a backpack or coat pocket.

Western Digital and Seagate had external SSD drives they were showing. Below is shown the G-Drive Mobile SSD-R, introduced late in 2017.

Memory Cards and SSDs
Samsung was at the NAB showing their EVO 860 2.5-inch. These SATA SSDs provide up to 4TB capacity and 550MB/s sequential read and 520MB/s sequential write speeds for media workstation applications. However, there were also showings of the product used in all-flash arrays as shown below.

ProGrade was showing its line of professional memory cards for high-end digital cameras. These included their SFExpress 1.0 memory card with 1TB capacity and 1.4GB/s read data transfer speed as well as burst write speed greater than 1GB/s. This new Compact Flash standard is a successor to both the C FAST and XQD formats. The product uses two lanes of PCIe and includes NVMe support. The product is interoperable with the XQD form factor. They also announced their V90 premium line of SDXC UHS-II memory cards with sustained read speeds of up to 250MB/s and sustained write speeds up to 200MB/s.

2018 Creative Storage Conference
For those who love storage, the 12th Annual Creative Storage Conference (CS 2018) will be held on June 7 at the Double Tree Hotel West Los Angeles in Culver City. This event brings together digital storage providers, equipment and software manufacturers and professional media and entertainment end users to explore the conference theme: “Enabling Immersive Content: Storage Takes Off.”

Also, my company Coughlin Associate is conducting a survey of digital storage requirements and practices for media and entertainment professionals with results presented at the 2018 Creative Storage Conference. M&E professionals can participate in the survey through this link. Those who complete the survey, with their contact information, will receive a free full pass to the conference.

Our main image: Seagate products in an editing session, including products in a Pelican case for field work. 


Tom Coughlin is president of Coughlin Associates, a digital storage analyst and  technology consultant. He has over 35 years in the data storage industry. He is also the founder of the Annual Storage Visions Conference and the Creative Storage Conference.

 

IBC 2016: VR and 8K will drive M&E storage demand

By Tom Coughlin

While attending the 2016 IBC show, I noticed some interesting trends, cool demos and new offerings. For example, while flying drones were missing, VR goggles were everywhere; IBM was showing 8K video editing using flash memory and magnetic tape; the IBC itself featured a fully IP-based video studio showing the path to future media production using lower-cost commodity hardware with software management; and, it became clear that digital technology is driving new entertainment experiences and will dictate the next generation of content distribution, including the growing trend to OTT channels.

In general, IBC 2016 featured the move to higher resolution and more immersive content. On display throughout the show was 360-degree video for virtual reality, as well as 4K and 8K workflows. Virtual reality and 8K are driving new levels of performance and storage demand, and these are just some of the ways that media and entertainment pros are future-zone-2increasing the size of video files. Nokia’s Ozo was just one of several multi-camera content capture devices on display for 360-degree video.

Besides multi-camera capture technology and VR editing, the Future Tech Zone at IBC included even larger 360-degree video display spheres than at the 2015 event. These were from Puffer Fish (pictured right). The smaller-sized spherical display was touch-sensitive so you could move your hand across the surface and cause the display to move (sadly, I didn’t get to try the big sphere).

IBM had a demonstration of a 4K/8K video editing workflow using the IBM FlashSystem and IBM Enterprise tape storage technology, which was a collaboration between the IBM Tokyo Laboratory and IBM’s Storage Systems division. This work was done to support the move to 4K/8K broadcasts in Japan by 2018, with a broadcast satellite and delivery of 8K video streams of the 2020 Tokyo Olympic Games. The combination of flash memory storage for working content and tape for inactive content is referred to as FLAPE (flash and tAPE).

The graphic below shows a schematic of the 8K video workflow demonstration.

The argument for FLAPE appears to be that flash performance is needed for editing 8K content and the magnetic tape provides low-cost storage the 8K content, which may require greater than 18TB for an hour of raw content (depending upon the sampling and frame rate). Note that magnetic tape is often used for archiving of video content, so this is a rather unusual application. The IBM demonstration, plus discussions with media and entertainment professionals at IBC indicate that with the declining costs of flash memory and the performance demands of 8K, 8K workflows may finally drive increased demand for flash memory for post production.

Avid was promoting their Nexis file system, the successor to ISIS. The company uses SSDs for metadata, but generally flash isn’t used for actual editing yet. They agreed that as flash costs drop, flash could find a role for higher resolution and richer media. Avid has embraced open source for their code and provides free APIs for their storage. The company sees a hybrid of on-site and cloud storage for many media and entertainment applications.

EditShare announced a significant update to its XStream EFS Shared Storage Platform (our main image). The update provides non-disruptive scaling to over 5PB with millions of assets in a single namespace. The system provides a distributed file system with multiple levels of hardware redundancy and reduced downtime. An EFS cluster can be configured with a mix of capacity and performance with SSDs for high data rate content and SATA HDD for cost-efficient higher-performance storage — 8TB HDDs have been qualified for the system. The latest release expands optimization support for file-per-frame media.

The IBC IP Interoperability Zone was showing a complete IP-based studio (pictured right) was done with the cooperation of AIMS and the IABM. The zone brings to life the work of the JT-NM (the Joint Task Force on Networked Media, a combined initiative of AMWA, EBU, SMPTE and VSF) and the AES on a common roadmap for IP interoperability. Central to the IBC Feature Area was a live production studio, based on the technologies of the JT-NM roadmap that Belgian broadcaster VRT has been using daily on-air all this summer as part of the LiveIP Project, which is a collaboration between VRT, the European Broadcasting Union (EBU) and LiveIP’s 12 technology partners.

Summing Up
IBC 2016 showed some clear trends to more immersive, richer content with the numerous displays of 360-degree and VR content and many demonstrations of 4K and even 8K workflows. Clearly, the trend is for higher-capacity, higher-performance workflows and storage systems that support this workflow. This is leading to a gradual move to use flash memory to support these workflows as the costs for flash go down. At the same time, the move to IP-based equipment will lead to lower-cost commodity hardware with software control.

Storage analyst Tom Coughlin is president of Coughlin Associates. He has over 30 years in the data storage industry and is the author of Digital Storage in Consumer Electronics: The Essential Guide. He also  publishes the Digital Storage Technology Newsletter, the Digital Storage in Media and Entertainment Report.