BBC Redux

From HandWiki
Short description: Digital archiving system produced by the BBC

BBC Redux was a BBC Research & Development system that digitally recorded[1] television and radio output in the United Kingdom produced by the British Broadcasting Corporation.[2]:2 It operated from 2007 to 2022[1][3] and contains several petabytes of recordings[1] and subtitle data.[1] It is notable for being the proof of concept for the Flash video streaming version of the BBC iPlayer.[2]:15

It was an internal research project developed for testing[4][5][6] which acted as a giant video on demand or personal video recorder (PVR).[4] It contained a complete digital archive, recording both television and radio twenty-four hours a day, of all of the BBC's national and also some regional broadcast output since mid-2007,[7][8] and automatically compiled without human input.[2]:5[6] The BBC stated that BBC Redux was one of its major contributions to the field of digital archiving and preservation.[9]

Some accounts for accessing the system on a temporary basis were made available at Mashed 08[10] and again at Culture Hack Day 2011,[11] providing streaming-only access to BBC content broadcast during the weekend of the event.[12] As well as streaming, the system enables high-quality downloads of television and radio content,[13] and has had the option to download subtitles from programmes since 2008.[14]

BBC Redux had originally been developed at the BBC's Kingswood Warren campus,[15] in only two months,[16] and with the investment required being significantly less than the iPlayer.[6] The saved content can be used for broadcast compliance checking[2]:16 and by BBC programme researchers.[17] BBC Redux was only available to employees, because existing legal contracts with content producers limited how material could be broadcast, distributed and made available to general consumers.[18][19] The Readme file for associated API frameworks hosted on GitHub states:

BBC Snippets and BBC Redux are tools designed to allow BBC staff to develop new ways to view and navigate content. As such, they're not open to the public.[20]

In May 2022, in a blog post, the BBC confirmed the sunset and ultimate closure of the Redux service. Redux content was migrated to the new BBC Archive Search, which operates on Amazon Web Services. New programmes are delivered to the BBC Archive automatically as they are ingested for playout.[3]

Technical details

The system recorded over 100 megabits per second, continuously.[2]:3 (As of August 2011), BBC Redux contained 300,000 hours of recorded audio and video.[21]

A series of standard Digital Video Broadcasting terrestrial antennas and satellite dishes, coupled to DVB-T and DVB-S TV tuner cards were used to capture the incoming DVB multiplexes[19] transmitted for over-the-air Freesat and Freeview terrestrial television.[2]:5 These raw MPEG transport streams are split into single-programme MPEG transport streams, encapsulated in RTP, and sent using UDP IP multicast within the IPv4 multicast address range 233.122.227.0/24 from AS31459.[2]:5 From the multicast streams individual television programmes can be extracted and saved, without requiring any transcoding or conversion of the contained MPEG-2 video data.[2]:5

(As of May 2009), racks of Sun Fire T1000 and T2000 machines were used acquiring and storing the incoming programmes respectively; while commodity x86-64 computers were used for database operations and playback transcoding.[2]:4 The T2000 storage nodes were connected by 10 Gigabit Ethernet on the network side,[2]:7 and then by serial attached SCSI to RAID boxes containing high-capacity commodity Serial ATA hard disk drives.[2]:7 The "fsck-free" ZFS file system was used after experiments with Unix File System (UFS) proved it to be too slow.[2]:8 Sun Microsystems had to manually repair the filesystems on two occasions using Unix dd.[2]:11–13

The software was based on open source technologies,[6] and used a combination of mod perl and C running on OpenSolaris.[2]:9,14 A series of "lolcat" images were used for the system's HTTP 404 and error pages.[22]

Projects

As part of the European Union (EU) "NoTube" project running between 2009–12, a recommendation research system using Lonclass categorisation and Tanimoto coefficient matching was tested by the BBC R&D Audience Experience team and integrated with 23,000 recordings delivered from Redux.[23] The matching dataset was gathered over a period of five months.[24]

For a BBC Digital Media Initiative (DMI) demonstration entitled "Million Minutes", files from the BBC's D-3 video tape archive were imported into the Redux system during 2009–2010.[17] This also used commercial software from Artesia Digital Media Group and involved creating a representational state transfer (REST) interface onto the content stored within Redux.[25]

During 2010, Safari[26] and Google Chrome[27] browser extensions were developed to integrate Redux content with the main www.bbc.co.uk/programmes directory.[28]

In January 2012, the BBC's Multimedia Classification team announced they were hoping to test and add "mood-based navigation" to the existing BBC Redux interface,[29][30][31] along with audience measurement and other rich metadata comprising work part-funded by the Technology Strategy Board.[7] During 2010–2011 BBC Research and Development integrated content archived in BBC Redux with the BBC's existing internal BBC InFax system, allowing finding of metadata and archive content within the same browser window,[32] covering news and subtitles from over the previous five years.[33]

During March 2012, the Atlas index changed the method of equivalence matching used for indexing against BBC Redux.[34]

References

  1. ↑ 1.0 1.1 1.2 1.3 Solon, Olivia (16 June 2011). "The people and projects inside the BBC's vast R&D lab". Wired. https://www.wired.co.uk/news/archive/2011-06/16/bbc-research-and-development?page=all. Retrieved 12 May 2012. 
  2. ↑ 2.00 2.01 2.02 2.03 2.04 2.05 2.06 2.07 2.08 2.09 2.10 2.11 2.12 2.13 Bird, Tom (28 May 2009). "BBC Redux". Sheffield: UKNOF 13. pp. 2–16. http://www.uknof.org.uk/uknof13/Bird-Redux.pdf. 
  3. ↑ 3.0 3.1 "The future of searching the past: Transitioning from BBC Redux to Archive Search". 26 May 2022. https://www.bbc.co.uk/blogs/internet/entries/491df53c-c2ab-42b5-abed-b02dc40e9442. 
  4. ↑ 4.0 4.1 Butterworth, Brandon (27 October 2008). "History of the 'BBC Redux' project". BBC Internet Blog. https://www.bbc.co.uk/blogs/bbcinternet/2008/10/history_of_the_bbc_redux_proje.html. 
  5. ↑ Saran, Cliff (20 April 2012). "BBC wants to build a cultural API". ComputerWeekly.com. http://www.computerweekly.com/news/2240148820/BBC-wants-to-build-a-cultural-API. "an internal version of BBC iPlayer called Redux, which was originally developed for testing" 
  6. ↑ 6.0 6.1 6.2 6.3 Rose, Anthony (2008). Kozamernik, F.. ed. "Evolution of the BBC iPlayer". EBU Technical Review (European Broadcasting Union) (Q4): 2. http://tech.ebu.ch/docs/techreview/trev_2008-Q4_iPlayer.pdf. Retrieved 13 May 2012. ;
    Rose, Anthony (24 February 2009). Kozamernik, F.. ed. "Evolution of the BBC iPlayer". EBU Technical Review (European Broadcasting Union) (The Best of 2008): 5. http://tech.ebu.ch/docs/techreview/trev_bestof08.pdf. Retrieved 13 May 2012. 
  7. ↑ 7.0 7.1 Tinley, Dominic (8 November 2011). "ABC-IP and work on audio archiving research". BBC Research & Development Blog. https://www.bbc.co.uk/blogs/researchanddevelopment/2011/11/abc-ip-and-work-on-audio-archi.shtml. 
  8. ↑ Tweed, Jonathan (7 November 2011). "Introducing Tellytopic: Navigating programme archives by topic". MetaBroadcast. http://metabroadcast.com/blog/introducing-tellytopic-navigating-programme-archives-by-topic. "BBC Redux, a playable archive of almost everything broadcast since mid-2007" 
  9. ↑ Wright, Richard (16 June 2010). "The Value of Everything". BBC Research & Development Blog. https://www.bbc.co.uk/blogs/researchanddevelopment/2010/06/the-value-of-everything.shtml. 
  10. ↑ Johnson, Bobbie (26 June 2008). "Hackers fan the flames of imagination at Mashed". The Guardian. https://www.theguardian.com/technology/2008/jun/26/hacking.mashed08. 
  11. ↑ Williams, Dan W. (14 January 2011). "BBC Archive − A number of Redux accounts giving…". Tumblr. http://tumblr.iamdanw.com/post/2744690731/bbc-archive-a-number-of-redux-accounts-giving. 
  12. ↑ "Datasets". Culture Hack Day. 14 January 2011. http://culturehackday.org.uk/wiki/Main/Datasets. 
  13. ↑ "Programme". EBU Seminar on P2P delivery. Geneva: European Broadcasting Union. 24 September 2008. http://tech.ebu.ch/docs/events/p2p08/ebu_p2pseminar_08_programma_v3.pdf. Retrieved 20 May 2012. "BBC Research developed a Redux site enabling a high quality download service of some BBC TV products." 
  14. ↑ "BBC Redux". Backnetwork. Madgex. 2008. http://mashed08.backnetwork.com/event/?articleid=32. 
  15. ↑ Forrester, Ian (14 March 2011). "Goodbye Kingswood warren". Cubic Garden. http://cubicgarden.com/tag/kingswood/. 
  16. ↑ Singleton, Alex (May 2008). "Linux at the BBC" (Platform-neutral content). Linux Format (105): 50. http://diracvideo.org/download/press/LXF105.bbc_LPDF.pdf. Retrieved 19 May 2012. "Brandon Butterworth explains: 'People thought it would be really difficult to run on all platforms, that it would take years to develop. But I led a team to do a Flash version that would work on Linux and we did it in two months'". 
  17. ↑ 17.0 17.1 "Highlights of the Year". BBC R&D Annual Review 2009–2010: 4. 10 March 2011. http://downloads.bbc.co.uk/rd/pubs/annual-review/bbc_rd_annual_review_2009-2010.pdf. Retrieved 13 May 2012. 
  18. ↑ Rivera, Ralph (11 May 2012). "BBC Online Briefing: Spring 2012 Final Q&A" (television question and answer session, offset 23:28–28:30). BBC Internet Blog. https://www.bbc.co.uk/blogs/bbcinternet/2012/05/bbc_online_briefing_final_qa.html. 
  19. ↑ 19.0 19.1 Tinworth, Adam (20 April 2012). "The UK's cultural heritage as digital public space". One Man and His Blog. http://www.onemanandhisblog.com/archives/2012/04/the_uks_cultural_heritage_as_digital_pub.html. "BBC Redux is iPlayer on steroids – with an API. It records the whole digital multiplex, … But the rights are complicated- because the BBC doesn't own many of the programmes it broadcasts." 
  20. ↑ Haynes, Matt (25 January 2012). "README.md". redux-client-ruby. GitHub. https://github.com/bbcsnippets/redux-client-ruby/blob/master/README.md. 
  21. ↑ Davies, Sam; Bland, Denise (1 August 2011). "BBC R&D – Archives Research". p. 4. http://staff.science.uva.nl/~kamps/entertainme/presentations/04-Sam.pdf. 
  22. ↑ Eden, Terence (30 September 2011). "I do like the BBC Redux 404 page". @edent. Twitter. https://twitter.com/edent/status/119776630569836546/photo/1. 
  23. ↑ "NoTube Archive Browser Experiment 1". NoTube Archive Browser. 19 December 2011. http://labs.notu.be/1/bbc/about.html. 
  24. ↑ Miller, Libby (14 October 2011). "Algorithms for recommendations in various N-Screen implementations". NoTube. http://notube.tv/2011/10/14/algorithms-for-recommendations-in-various-n-screen-implementations/. 
  25. ↑ James, Bruce (5 November 2009). "ArcHak". CustardCat. http://custard-cat.blogspot.co.uk/2009/11/archak-bbc-research-and-development.html. 
  26. ↑ Starling, Sam (4 September 2011). "README.md". Safari-Redux-Switcher. GitHub. https://github.com/whomwah/Redux-Switcher/blob/master/README.md. 
  27. ↑ Robertson, Duncan (26 August 2010). "README.md". Redux Switcher. GitHub. https://github.com/whomwah/Redux-Switcher/blob/master/README.md. 
  28. ↑ "Prototyping Weeknotes #29". BBC Research & Development Blog. 27 August 2010. https://www.bbc.co.uk/blogs/researchanddevelopment/2010/08/-prototyping-weeknotes-29-2708.shtml. 
  29. ↑ DTG Staff (18 January 2012). "BBC R&D develops 'mood based navigation'". News. Digital TV Group. http://www.dtg.org.uk/news/news.php?id=4296. 
  30. ↑ Campbell, Rosie (16 January 2012). "An Affective Interface for Mood-Based Navigation". BBC Research & Development Blog. https://www.bbc.co.uk/blogs/researchanddevelopment/2012/01/an-interface-for-mood-based-navigation.shtml. 
  31. ↑ BBC Research and Development (January 2011). "Multimedia Classification". Projects. https://www.bbc.co.uk/rd/projects/2009/10/mulitmedia_classification.shtml. "User Evaluation on BBC Redux (by BBC staff) …" 
  32. ↑ "Highlights of the Year". BBC R&D Annual Report 2010–2011: 5. 15 November 2011. http://downloads.bbc.co.uk/rd/pubs/annual-review/bbc_rd_annual_review_2010-2011.pdf. 
  33. ↑ McAthy, Rachel (20 April 2012). "#ODCC – Open data and the 'new digital fields of exchange'". Journalism.co.uk. Mousetrap Media Ltd. http://blogs.journalism.co.uk/2012/04/20/odcc-open-data-and-the-new-digital-fields-of-exchange/. 
  34. ↑ Tweed, Jonathan (21 March 2012). "Atlas release notes - week to 20th March". MetaBroadcast. http://metabroadcast.com/blog/atlas-release-notes-week-to-20th-mar. "Changes to the behaviour of BBC Redux equivalence" 

External links



Retrieved from "https://handwiki.org/wiki/index.php?title=BBC_Redux&oldid=3381914"