Home Networking as a Distributed File System view Serge Defrance, Rémy Gendrot, Jean Le Roux, Gilles Straub, Thierry Tapie Technicolor R&D, Rennes, France. Distributed Storage, Rennes, September 2011 Outline The How The 2 3/12/2016 problem and our approach to implement the proposed solution potential benefits for user applications Where our reflexion starts… Heterogeneous home network environment ? PCs Tablets 3 Game Consoles NAS TV sets Organize the access to the content stored in or from the various devices. 3/12/2016 A unique protocol UPNP/DLNA, the most accomplished candidate Zero configuration protocol Targets unskilled users Still evolving Requires updates May generate incompatibilities NAS PCs Tablets 4 3/12/2016 Game Consoles TV sets Our gateway-centric approach Minimize software installation on devices Central Equipment connected to each device Always powered on May be controlled by the ISP (or a “service” provider) Move all software installation on the gateway Use it as a protocol translator NAS PCs Tablets 5 3/12/2016 Game Consoles TV sets Organize a file system view Take benefits of the VFS abstraction layer A connected device appears as a folder in the tree structure of the gateway This choice ensures backward compatibility with the existing applications The challenge : automate VFS modules installation and setup 6 3/12/2016 The home network organizer An automation software running on the gateway Communication starts via http on user initiative Gateway http communication HTTP Server Network organizer VFS GdataFS Dropbox client DJMount NFS SMB http communication 7 3/12/2016 Access to UPNP/DLNA devices Zero configuration protocol solves the automation problem A Fuse module to map under the VFS other UPNP/DLNA servers Djmount Gateway HTTP Server Network organizer VFS … … DJMount … … Upnp/Dlna servers 8 3/12/2016 Cloud storage systems Experimented Dropbox and GdataFS for Youtube and Picassa Automate the installation and configuration of the modules Gateway http communication HTTP Server Network organizer VFS GdataFS 9 3/12/2016 Dropbox client DJMount … SMB/NFS devices Collects information via http (user name, type of device, IP…) Creates appropriate folders and associated exports… …on the gateway and on the device via an appropriate script Gateway http communication HTTP Server Network organizer VFS GdataFS Dropbox client DJMount NFS SMB http communication 10 3/12/2016 Tree structure Gateway view NetworkShares Dropbox User (Bob) PC view OtherNetworks NetworkShares Dropbox DJMount DJMount GdataFS OtherShares Jean GdataFS UsersShares OtherShares Jean Serge Serge Bob Bob MyShare 11 3/12/2016 Benefits for the applications Backward compatibility : distant storage appears as local. Use of previous file manager or media player Gateway ... http communication HTTP Server Indexation Network Organizer UPNP DLNA Server VFS DLNA TV GdataFS Dropbox client DJMount NFS SMB Local FS SMB 12 3/12/2016 Enhanced navigation 13 3/12/2016 Enhanced navigation 14 3/12/2016 Enhanced navigation Via a UPNP/DLNA media server on top of the VFS Offers any VFS content to a UPNP/DLNA client PS3 Media Server, MiniDlna Gateway ... http communication HTTP Server Indexation Network Organizer or miniDlna VFS DLNA TV GdataFS Dropbox client DJMount NFS SMB http communication 15 3/12/2016 Enhanced navigation 16 3/12/2016 Enhanced navigation 17 3/12/2016 Enhanced navigation 18 3/12/2016 Content indexation : DAM Open source software. Merge indexation and Network Organizer functions Gateway HTTP Server DAM (Indexation + NetworkOrganizer) VFS GdataFS 19 3/12/2016 Dropbox client DJMount NFS SMB Unique interface : DAM 20 3/12/2016 Advanced remote control Via a web browser Same menu for all devices http Control Gateway ... HTTP Server DAM Upnp Control Point (Indexation + NetworkOrganizer) Upnp Media Server VFS GdataFS 21 3/12/2016 Tablet Dropbox client UPnP Control DLNA TV DJMount NFS SMB Home network content backup Backup software runs on the gateway Local or distant safe storage. http Control Gateway HTTP Server Back Up application DAM Upnp Control Point (Indexation + NetworkOrganizer) Upnp Media Server VFS GdataFS 22 3/12/2016 Tablet Dropbox client UPnP Control DLNA TV DLNA TV DJMount NFS SMB New Home storage architecture High peer availability Cloud/peer to peer/hybrid Home systems may contribute to cloud storage capabilities Storage in the Cloud 50 % free space 23 3/12/2016 Conclusion Unify the content access in the home network heterogeneous environment Automate the deployment of the Unix VFS Network Organizer running on the gateway Leveraging user experience 24 Navigation, indexation, remote control, backup Many open tracks Home storage architecture Data sharing Security … 3/12/2016 Technicolor Innov8 expo, June 21 – 23, 2011, London, UK. 25 3/12/2016 Acknoledgement 26 This study was partially funded by the FIGARO (Future Internet Gateway-based Architecture of Residential networks, FP7-ICT-258378) collaborative project. 3/12/2016 Thank you ! serge.defrance@technicolor.com Distributed Storage, Rennes, September 2011 SMB/ NFS devices : first Registration (1/2) Collects information relative to the new comer Creates appropriates folders and exports on the gateway and generates an appropriate script for the client….. User information User information Gateway HTTP Server HTTP Windows HTTP Linux Lea Client John Client Make client script and build folders Network Organizer Share_dir Lea_dir 28 3/12/2016 John_dir SMB/ NFS devices : first Registration (2/2) Proposes the appropriate script for execution to the new comer Script, which creates appropriates folders and exports on the client (new comer) . Download client script Download client batch Gateway HTTP Server HTTP Windows HTTP Linux Lea Client John Client Network Organizer Launch installation and build folders! Share_dir OtherShares Lea_dir MyShares 29 3/12/2016 Launch installation and build folders! OtherShares John_dir MyShares SMB / NFS Devices : then Connection (1/2) Each time a user/device joins the home network Activate the prepared mounts/exports Gateway Connect Connect HTTP Server HTTP Windows HTTP Linux Lea Client John Client Network Organizer Export and mount folders OtherShares share Lea_dir MyShares 30 3/12/2016 Share_dir export OtherShares John_dir MyShares SMB / NFS Devices : then Connection (2/2) Disconnection (unmount) when leaving the home network An absent device appears as disconnected (regular pings) User disconnection request or cable disconnection Gateway HTTP Server HTTP Windows HTTP Linux Lea Client John Client Network Organizer Umount folder and rename it as disconnected OtherShares Share_dir OtherShares John_dir MyShares Lea_dir_disconnected 31 3/12/2016 MyShares UPNP/DLNA devices http Control Gateway HTTP Server Back Up application Upnp Control Point DAM (Indexation + NetworkOrganizer) Upnp Media Server VFS GdataFS 32 3/12/2016 Tablet Dropbox client UPnP Control DLNA TV DJMount NFS SMB