Table of Contents Format description
An overview of table of content for the format description on piqlFilm
Version 1.0.1
Table of Contents
- INTRODUCTION
- TABLE OF CONTENTS
- FORMAT
3.1. Identification
3.2. Visual Layout Definitions
3.3. File Format Definitions
3.4. Reel
3.5. Descriptive Files or Representation Information
3.6. User Data Files
3.7. Digital Data Locations
3.8. Visual Data Locations
1. INTRODUCTION
The Table of Content (TOC) is a component of the Piql File System and lists all parts preserved on a Piql reel. The TOC is written in digital and visual format on the reel at the beginning and at the end of it for redundancy. The TOC enables to retrieve digital and visual data making it a key component within the Piql File System.
The following chapters describe the TOC format.
2. TABLE OF CONTENTS
Within the Piql File System, the TOC accomplishes two functions. First, it acts as an index locating the clients’ preserved data and metadata and second, it defines the file formats preserved on the reel and defines the visual preservation page layouts within a single frame.
Every reel must contain a TOC in digital and visual format, independent of the preservation service (digital, hybrid or visual) requested by the client.
A TOC is automatically generated when a Job is uploaded to the Piql system. A Job is equivalent to an Archival Information Package (AIP) which is defined by the Open Archival Information System (OAIS) digital repository model as the preservation package that contains all data and metadata delivered for preservation. A physical reel contains only one AIP or Job. A TOC could expand to one or more reels.
- Every TOC is related to a Job ID and Reel ID.
- The Job ID is a unique ID generated by the Piql system to identify a preservation package uploaded by the client. The Job ID is used for Job identification and for tracking the preservation process within the Piql system
The Reel ID is a unique ID generated by the system to identify the physical medium.
3. FORMAT
The TOC contains several sections:
3.1. Identification
The Identification section shows the reel (Reel ID) and preservation package (Job ID) to which the
TOC belongs to. It describes how many reels are covered by the TOC and the TOC format version.
Example: TABLE OF CONTENT
Job ID: 71A2D51D-1C44-22D2-5745-5BF76A4CD6E5 Reel ID: A2402EA4-6937-3784-429B-C9D85AC24E1E
Version: 1.0.1 Number of reels: 1
3.2. Visual Layout Definitions
When preserving a file in visual or hybrid format, an analogue copy of the file is written on film. Piql system provides the flexibility to print several rendered pages (or files) per frame. This flexibility is provided by creating multiple templates (layout definitions) that defines each page position within a frame. These templates can be associated to a specific file format or file name.
The TOC presents the visual layout definitions, so pages and its position within a frame are easily
found. Example of two visual templates writing one page per frame and ten pages per frame:
VISUAL LAYOUT DEFINITIONS
========================
<layoutId> <sections> <name>
00000 00010 "10 pages per frame"
00001 00001 "1 page per frame"
<layoutId> <sectionId> <x> <y> <width> <height> <rotation>
00000 00001 00000 00000 00805 01046 000
00000 00002 00805 00000 00805 01046 000
00000 00003 01610 00000 00806 01046 000
00000 00004 02416 00000 00806 01046 000
00000 00005 03222 00000 00806 01046 000
00000 00006 00000 01046 00805 01046 000
00000 00007 00805 01046 00805 01046 000
00000 00008 01610 01046 00806 01046 000
00000 00009 02416 01046 00806 01046 000
00000 00010 03222 01046 00806 01046 000
00001 00001 00000 00000 04028 02092 000
3.3. File Format Definitions
This section defines all preservation file format specifications contained in a specific preservation package (AIP or Job). All preservation file formats are identified with a Pronom ID, file format name and version used. Pronom is a file format information system developed by the UK National Archives for long term preservation of electronic records. Today, it is a publicly accessible international resource for identification of file formats and their corresponding rendering software.
Example:
FILE FORMAT DEFINITIONS
<formatId> <PronomId> <Name>
00000 fmt/95 "Acrobat PDF/A - Portable Document Format"
00001 fmt/353 "TIFF - Tagged Image File Format"
<formatId> <fileId> <type>
00000 00000 METADATA
00000 00001 DOCUMENT
00000 00002 SOURCE-CODE
00001 00003 METADATA
00001 00004 DOCUMENT
00001 00005 SOURCE-CODE
3.4. Reel
The reel section identifies the reel ID and the number of files being preserved.
Example:
REEL
====
Reel ID: A2402EA4-6937-3784-429B-C9D85AC24E1E
Number of files: 23
3.5. Descriptive Files or Representation Information
This section describes all files needed for decoding the preserved content anytime in the future. They include Piql technology descriptive information, open source decoding software, file format specifications and customized client files to identify the preservation package. This section is the “Representation Information” defined by the Open Archival Information System (OAIS) reference model for digital repositories. These files are not fixed, they might vary according to file formats preserved and customer requests. The TOC will identify each file within the Representation Information.
Example:
DESCRIPTIVE FILES
<id> <parentId> <metadataId> <filename>
00000 0000N 00001 PDF-A-1.4.xml
00001 0000N 0000N PDF-A-1.4.pdf
00002 0000N 0000N PDF-A-1.4.tar
00003 0000N 00004 TIFF.xml
00004 0000N 0000N TIFF 6.0.pdf
00005 0000N 0000N libtiff.tar
3.6. User Data Files
It identifies every individual client file being preserved on film. Each file is associated to its preservation package (AIP file name)
Example:
USER DATA FILES
===============
<id> <parentId> <metadataId> <filename>
00006 0000P 0000N WorldWonders.tar
00007 00006 00004 New_7_Wonders_Winners_metadata.xml
00008 00006 0000N New_7_Wonders_Winners.tif
00009 00006 00004 Al_Khazneh_metadata.xml
00010 00006 0000N Al_Khazneh.tif
00011 00006 00004 Chichen_Itza_metadata.xml
00012 00006 0000N Chichen_Itza.tif
3.7. Digital Data Locations
This section provides the location of digital preserved files. It shows the main parameters to search for a file and for verification of data integrity.
The parameters for each file are fileID, uniqueID, frame and byte start and end, size of the file, date when the file was written on film and the checksum.
Example:
DIGITAL DATA LOCATIONS
<id> <uniqueid> <startframe> <startbyte> <endframe> <endbyte> <size> <date> <sha1 checksum>
00000 7874E91F-5637-809D-8E2D-914FB8B9E9E5 000135 00000000 000259 01209439 0217262080
2015-02-04T08:52:36 c7e72008458dc3e4cb3c73c0f548955234f49ead
00001 22F0DE4E-FF71-3DB6-531F-FC5313600F02 000135 00000000 000135 00001023 0000001024
2015-01-26T15:05:58 e38992c15182ca3259e06cd1b1084694b9796fed
00002 1F2ED6CD-53E9-0AF5-D05C-CAFED6ED5EF6 000135 00001024 000149 00784047
0025176064 2015-01-28T15:44:12 86bfec8a983cb22d65566416068cbb9889400c0c
00003 D24B808E-3673-068D-6D93-7915FF24D2AA 000149 00784048 000149 00785071
0000001024 2015-01-26T14:29:18 f2ff3d5434426984fddaab364bce471c210745ab
00004 4E5CEDA1-4144-7C2E-AB11-4263197EB18F 000149 00785072 000155 01539615
0011208704 2015-01-29T10:10:06 9cb24251e82165999421f8b1a9ca828a92f40599
00005 FEBDB6EF-724F-F6D9-1EA6-0191A1F52742 000155 01539616 000155 01540639
0000001024 2015-01-27T10:07:43 d00cf22efb71b8d447b74e294caecc5dc5a6e3e8
00006 5FF15E0D-04CF-A98C-7327-4B8EC73FE714 000155 01540640 000165 01487663
0017370624 2015-01-28T15:46:56 c8e1aa39ad58745f518fc2eb4384988f79630bb3
00007 605CE59F-A5E4-E705-A2CE-E4CABF996ADC 000165 01487664 000165 01488687
0000001024 2015-01-26T14:34:32 cfb540526d9f184fd6144a901656a4e920cbf7b9
00008 B2898182-6764-E798-9567-92241BE76B31 000165 01488688 000175 00272447 0016207360
2015-01-28T15:41:44 80e1983ac0679a8945f9f17a30f01428e817ece4
3.8. Visual Data Locations
This section shows the location of the visual preserved files. It identifies the frame where the file starts, the starting section within the file starting frame, how many sections the file expands and dimensions.
Example: VISUAL DATA LOCATIONS
<id> <layoutid> <startframe> <startsection> <section count> <dimensionW> <dimensionH>
<overlap WxH>
00001 00000 000176 000000 000900 00000x00000 00000x00000
00004 00000 000256 000000 000100 00000x00000 00000x00000
00008 00001 000266 000000 000001 00000x00000 00000x00000
00010 00001 000267 000000 000001 00000x00000 00000x00000
00012 00001 000268 000000 000001 00000x00000 00000x00000