Tangible Media Project Guide
Transcription
Tangible Media Project Guide
2015 Information Guide & Process Manual Tangible Media Project Page Kimberly Jackson, Preservation Digital Technology Intern The Library of Congress 7/27/2015 0 Preservation & Reformatting Division Table of Contents Tangible Media Project (TMP) ..........................................................................................................................................................2 Defining the Tangible Media ........................................................................................................................................................2 Vulnerable Collections..................................................................................................................................................................2 Pilot Project: Preserving Tangible Media .....................................................................................................................................2 Before You Begin ..............................................................................................................................................................................3 How to Set Up Your Login/Station ...............................................................................................................................................3 Adobe Photoshop .........................................................................................................................................................................3 Familiarize Yourself with the Workflows .....................................................................................................................................4 Basic Workflow Pattern ....................................................................................................................................................................4 Workflow Processes .........................................................................................................................................................................5 Add Items to Tracking Spreadsheet .............................................................................................................................................5 Scan TIFs of Media........................................................................................................................................................................6 Acquiring Content from Media ...................................................................................................................................................... 14 Ripping CD/DCDs ....................................................................................................................................................................... 14 Re-Ripping MDF/MDS Discs for File Content ............................................................................................................................ 19 3” Mini CD/DVD Discs................................................................................................................................................................ 20 3.25” Floppy Disks ..................................................................................................................................................................... 25 5.25” Floppy Disks ..................................................................................................................................................................... 30 Acquiring Content Using FTK Imager ............................................................................................................................................. 37 Finding Content ......................................................................................................................................................................... 37 Creating a Physical Image.......................................................................................................................................................... 39 Creating a Logical Image............................................................................................................................................................ 42 Acquiring Content Using Command Prompt/XCopy ..................................................................................................................... 45 Assembling Content for CTS .......................................................................................................................................................... 46 CTS Ingest (post-ripping) ............................................................................................................................................................... 48 APPENDIX ...................................................................................................................................................................................... 57 Barcode Errors ........................................................................................................................................................................... 57 Unzip Errors ............................................................................................................................................................................... 57 Status Slips ................................................................................................................................................................................ 58 Page XCOPY Parameters/Commands................................................................................................................................................. 59 1 Tracking Spreadsheet ................................................................................................................................................................ 58 Tangible Media Project (TMP) Defining the Tangible Media Digital items stored on physical, tangible media. Includes, but is not limited to: CD/DVDs, Hard Drives, Thumb Drives, Digital Tape, Floppy Discs and Flash Drives. Does not include: Digital items transferred directly onto Library servers via FTP, or stored elsewhere and only accessed at the Library. Vulnerable Collections Digital items are kept across Library divisions, stored on a wide variety of degrading tangible media, with more items coming in every day. As long as the data remains only on the tangible media it is not backed up and is vulnerable. Pilot Project: Preserving Tangible Media In 2013, the Preservation and Reformatting Division Creating began a pilot program called the Tangible Media Project. The goal of this project is to create a preservation copy of digital tangible media which is included with newly bound monographs. The process to achieve a preservation copy includes: 2 Ripping the content from the media; Using forensic data extraction software if the media is not able to be ripped or if the media is obsolete or damaged; Creating tracking metadata; Assembling and inventorying the content (Bagging); Ingest into LC Content Transfer Services (CTS) which also runs a variety of scripts and software such as fixity checks, malware and virus scans, backed-up and stored in long term tape storage. Page Before You Begin How to Set Up Your Login/Station Before you can begin to work on the TMP, you must do the following: Verify that you have Adobe Photoshop, import scanning actions and create shortcuts Copy the Ripstation shortcuts folder to your desktop or taskbar. Know the login and password for FTK Imager (FTKAdmin, prdrocks!) Know the login and password for OptiPlex computer login (Administrator, [blank]) Adobe Photoshop PROMPT: You have been tasked with scanning TIF images of media for the TMP. ACTION 1: Confirm that you have access to Photoshop; add required recorded actions and menu shortcuts. Importing and Loading the Actions file 1. 2. 3. 4. 5. Go to the Ripstation (TMP3) computer and login using your LC username and password. Go to the Start Button and locate Photoshop, then right-click the icon and select Pin to Taskbar. Open Photoshop. View Actions by selecting Windows > Actions (Alt +F9) On the Right Side Panel select the Actions tab 6. 7. 8. 9. 10. 11. On the right corner of the panel, click on the drop down tool and select Load Actions. Locate and select the action file by going to: M:\PRD\OptiCopy\BCCD-MRC\_Instructions\Photoshop Actions Once the actions have loaded you will need to change the WIA Support destination folder. In the BCCD-MRC Action folder on the PSD panel, click on Begin Scan. Select WIA Support then, double-click. Under Destination Folder, click on Browse and change the save location to M:\PRD\OptiCopy\BCCDMRC\_MediaScans Adding Menu Shortcuts In the Photoshop drop-down menu, select Edit > Menus Select the Keyboard Shortcuts tab. Click on File > Save As. Click on the shortcut field and change by pressing the F11 button. Scroll to File > Close. Click on the shortcut field and change by pressing the F12 button. Scroll to Image > Image Rotation > Arbitrary. Click on the shortcut field and change by pressing the F10 button. 6. Click OK to save. Page 3 1. 2. 3. 4. 5. Familiarize Yourself with the Workflows All new incoming items from BCCD with tangible media will need to follow a specific workflow. You can begin familiarizing yourself with the process by looking at the signs in the TMP area and also by reading this guide. Receive New Items Return Completed Items for Shelving Add to Tracking Sheet Ingest Bagged Content into CTS Scan TIF Basic Workflow Pattern Bag Assembled Items Troubleshoot Errors 4 Return Unsolveable Items to Sender Page Assemble Ripped Files & TIFs for Bagging Rip Media Workflow Processes Add Items to Tracking Spreadsheet All new items must first be added to the tracking spreadsheet before any work is completed. This allows PRD to keep track of the activities performed on the items and by whom as well as any errors that occurred. This information is used later in the workflow process to glean metadata for ingest into CTS. 1. Choose 10 items from the new incoming items staging area and bring them to the workstation. 2. Open the Tracking Spreadsheet which is found in your Ripstation Shortcuts folder which should now be copied to your desktop or taskbar. 3. Go to the most recent blank line and scan the barcode into the first two lines. 4. Save the document. 5. You may now begin the first step in the workflow process – Scanning Media on a Flatbed Scanner. Figure 1: Choose new items. Page 5 Figure 2: Add new items to spreadsheet (barcode only). Scan TIFs of Media PROMPT: New Items Have Arrived From BCCD ACTION 1: Select 10 books from the cart and bring them to the scanning workstation and follow the steps below. ACTION 2: Check to make sure that the scanner cord is plugged in. ACTION 3: Log onto the scanning station computer with your LC username and password and open Photoshop. Figure 3: Cord connected. ACTION 4: If you have not already done so, open the Tracking Spreadsheet from the Ripstation shortcuts folder. Go to the end of the sheet, scan the barcode twice. Enter your name under the scanned by section after each item once they have been scanned. Do not add additional information until the action is performed. Page 6 Figure 4: Enter information into the tracking spreadsheet as actions are completed. ACTION 5: Take the CD/DVD out of the first book and place it label side down on the scanner. ACTION 6: In Photoshop, press F2 button, press ENTER to select the scanner device, and then ENTER once more to set it for a color scan. Quick Action: F2 + Enter + Enter Page 7 Figure 5: Press ENTER to select the scanner. Figure 6: Press ENTER once more to set scan for color. Once the scan starts you should see a progress bar. Figure 7: Progress bar in action. Once the scan is complete you’ll see it in Photoshop. Page 8 Figure 8: What you see when the scanner is finished scanning. ACTION 7: While in Photoshop, choose the CROP tool on the left side toolbar. ACTION 8: Click once in the white area until you see a grid. Figure 9: You will see a grid appear. ACTION 9: Move the image of the CD until the bull’s eye mark is in the center of the CD/DVD then press ENTER. Page 9 Figure 10: Center bull's eye mark to center of CD/DVD. ACTION 10: Select the RULER tool to align the item so that the text is level. If you do not see the ruler, right click on the Eyedropper tool and select Ruler Tool. ACTION 11: Once the Ruler Tool is selected, click once under the text on the media item, hold and draw a straight line, then release the mouse. Page 10 Figure 11: Draw a straight line under the text using the ruler tool. ACTION 12: After you have underlined the text and released the mouse, press F10 to rotate the image using arbitrary rotation. ACTION 13: You will see a suggested degree of rotation. Press ENTER. Figure 12: Suggested degree of rotation. Figure 13: Image text is now aligned. Page 11 The writing should now be straight. If not, repeat actions 8-10. ACTION 14: Press F4 for a final crop. Figure 14: Final Close Crop. ACTION 15: Press F11 (File>Save As). Figure 15: The automatic file name and format need to be changed. ACTION 16: Scan the LCCN barcode (located on the back of the item). Page 12 Figure 16: Scan the barcode to copy the number. ACTION 17: Add the _001 extension (or _002 etc. if there is more than one media item). Note: If there is more than one media item, then write the corresponding number on the Tyvek envelopes in pencil only. Figure 17: Add the CD number extension to the file name. ACTION 18: Press TAB + T + T to change the Format type to TIFF then press Save/Enter. Figure 18: ALWAYS save as TIFF. ACTION 19: When you see additional saving options, press OK/Enter. Page ACTION 20: Press F12 to close the image in your screen, select a new item and return to Action 1. 13 Figure 19: Verify TIFF options by pressing ENTER. Acquiring Content from Media Ripping CD/DCDs PROMPT: New items arrived from BCCD and have been scanned and their content needs to be ripped. ACTION 1: Select 10 items from the Scanned. Need to be Ripped stack. ACTION 2: Take your 10 items to either of the two (2) designated Ripstations (TMP1 or TMP3). 1. Be sure that an external hard drive is plugged in to the computer, that the Ripstation machine is on, and that the Ripstation cord is plugged in. Figure 20: Ready light should be green. Figure 21: Ripstation cord is plugged in. ACTION 3: Go to the Ripstation Shortcuts folder and open the file 1_RipstationLogin.txt. ACTION 4: Copy the login username for the station you are currently working (Ex: TMP3 station login = Page 14 LSH5ZJLC1\#1CLJZ5H). Keep this file open so you can still see the password information which will also be needed. ACTION 5: Go back to the Ripstation Shortcuts folder, locate the 2_Ripstation DataGrabber shortcut, right-click using your mouse and click on Run as Administrator. Figure 22: Ripstation Shortcuts ACTION 6: When the Admin login screen comes up, paste the login information (Ex: LSH5ZJLC1\#1CLJZ5H) ACTION 7: Press TAB, and then type in the password as seen on the login file (Ex: ^On3Day@tthePark). Should you need a new password, contact John Makar in APLO for assistance (202) 707-1248. Page 15 Figure 23: Logging into DataGrabber Figure 24: Verify all selections before ripping media. ACTION 8: Before placing any media in the device, be sure that the DataGrabber application shows the following: a. Loader Type is 7601XDP b. Output format is ISO Image c. Disc Count is 0 d. Folder Name is %0\1 e. The Destination Folder is F:\BCCD\ (be aware that the drive many vary) f. The G:\Optiarc drive is checked (be aware that the drive many vary) ACTION 9: Open the 3_UserData.txt file. ACTION 10: Delete any barcode numbers currently in the file and save. ACTION 11: Verify that there is a barcode on the back of the item. 1 It’s a variable that tells the program to name the file/folder with the Barcode ID that you put into the userdata file earlier. Page Figure 25: Add barcodes to UserData and save before ripping. 16 i. If there is no barcode present, go to Troubleshooting – Barcodes for more information. ACTION 12: Scan barcode on the back of each item to the UserData file and be sure to SAVE. ACTION 13: Remove the CD/DVD from the envelope and place it inside the Ripstation machine. ACTION 14: Continue to do this for all remaining discs for items selected until all are stacked in the machine and close the lid. ACTION 15: Navigate to the DataGrabber Program. ACTION 16: Verify the selections, and then click the green arrow to begin ripping. Page 17 Figure 26: Click on the green arrow to begin ripping. ACTION 17: As CD/DVDs are finished, they’ll drop out of the front into the container. ACTION 18: Any CDs that don’t rip will drop out of the bottom back. ACTION 19: As the ripped and error CDs come out, place them back in the item’s Tyvek envelope. ACTION 20: Update the status for each item on the tracking spreadsheet. ACTION 21: Place a Status Slip in each item where errors occurred and transfer it to the FRED station for further work on FTK or XCopy. ACTION 22: Set successful items aside for assembling. ACTION 23: Return to any items with MDF/MDS files that need to be re-ripped. Figure 28: Unripped Disc (Error Status). Page 18 Figure 27: Ripped disc (OK status). Re-Ripping MDF/MDS Discs for File Content There will be instances where content has ripped from CD/DVD media, but extracts an MDF/MDS file rather than an ISO. To remedy this, you must re-rip the media with the file output set to Files. PROMPT: Ripped discs extracted MDF/MDS format and need to be re-ripped. ACTION 1: Determine what items that were ripped need to be re-ripped by looking at the folder contents. ACTION 2: Open the 3_UserData.txt file. ACTION 3: Delete any barcode numbers currently in the file and save. ACTION 4: Scan barcode on the back of each item to the UserData file and be sure to SAVE. ACTION 5: Remove the CD/DVD from the envelope and place it inside the Ripstation machine. ACTION 6: Continue to do this for all remaining discs for items selected until all are Figure 27: Add barcodes to UserData stacked in the machine and close the lid. and save before ripping. ACTION 7: Navigate to the DataGrabber Program. ACTION 8: Verify that the output selection has been changed to Files, and then click the green arrow to begin ripping. Figure 28: Be sure to change output to Files. ACTION 9: Once the files have finished ripping, set aside for assembling. You can now move on to the next step in the Page 19 workflow process, Assembling Ripped Files for Bagging. 3” Mini CD/DVD Discs Mini CD/DVD discs must be ripped at the FRED station using FTK Imager or Xcopy. Do not attempt to rip multiple minidiscs using the adapter as it may cause unnecessary wear and tear and/or jam the Ripstation. On FTK, you will make a physical and logical copy. If this fails, you must clone the content using Xcopy in Command Prompt. See Using Command Prompt for additional instructions. PROMPT: There are several items with 3” mini CD/DVD items at the FRED station which need to be cloned. ACTION 1: Select one item from the stack, open the envelope containing the media and place in the mini-disc adapter. Be sure that the disc is label side up and is locked in correctly on all sides. Figure 29: Insert in label side up. Figure 30: Be sure it is locked into place. ACTION 2: Open the CD/DVD drive (F:/) on FRED, insert the disc label side up and close the drive. Page 20 Figure 31: Ready to copy content. ACTION 3: Open My Documents and navigate to the H:/ drive (aka Maui). ACTION 4: Create a new folder and name with the item barcode. Page 21 ACTION 5: Within that new folder, create two subfolders: Logical, and Physical. ACTION 6: Navigate to and open FTK Imager and click on Add All Attached Devices ACTION 7: Select the F:\ drive which contains the disc media, right click and select Export Disk Image. This is the physical copy of the disc which is a clone of the disc geometry, or a complete physical copy. Page 22 ACTION 8: Click on Add to add the disk image source. ACTION 9: Browse to the destination (save to) folder you created in the H:\ drive entitled Physical and insert the barcode for the Image Filename. ACTION 10: Click on Finish, then click Start to begin the process. ACTION 11: When the process is finished, click Close twice 23 Figure 35: When completed, click close. Page Figure 32: Creating physical image of disc. ACTION 12: Next, you will need to extract an archival copy of the logical image of the disc. The logical copy serves a listing of the data set and also a set of pointers which lead to the physical copy of the disc content. Please note that if the data from the physical copy changes, then these pointers on the logical copy may not point to the files properly. ACTION 13: After selecting Export Logical Image, you will be prompted to select the file folder where you wish to save the logical copy. Click, Add > Next (do not add any metdata)> H:\ > FTK_Images > [Barcode specific to item] > Logical. ACTION 14: Add the Image Filename (Barcode specific to item). ACTION 15: Click on Finish and allow FRED to run through cloning the logical image of the disc. When it is done with the Page 24 process you will see a screen which shows a fixity check/checksum for both SHA1 and MD5 algorithms. Fixity checks/checksums also known as hashes are meant to guarantee authenticity that the file has not changed from the time that it was cloned to the time that it is opened for use by an outside user or otherwise. 3.25” Floppy Disks 3.25” floppy discs must be ripped at the FRED station using FTK Imager or Xcopy. Using FTK, you will make a physical and logical copy. If this fails, you must clone the content using Xcopy in Command Prompt. See Using Command Prompt for additional instructions. PROMPT: There are several items with 3.25” floppy disks at the FRED station which need to be cloned. ACTION 1: Select one item from the stack, open the envelope containing the media and insert it into the 3.25” floppy reader label side up. Be sure that it is connected to a USB port. Figure 36: Insert in label side up. Figure 37: Be sure it is locked into place. Page 25 Figure 38: Plug in the drive reader and turn on write protect. ACTION 2: Open My Documents and navigate to the H:\ drive (aka Maui). ACTION 3: Create a new folder and name with the item barcode. Page 26 ACTION 4: Within that new folder, create two subfolders: Logical, and Physical. ACTION 5: Navigate to and open FTK Imager and click on Add All Attached Devices ACTION 6: Select the F:\ drive which contains the disc media, right click and select Export Disk Image. This is the physical copy of the disc which is a clone of the disc geometry, or a complete physical copy. Page 27 ACTION 7: Click on Add to add the disk image source. ACTION 8: Browse to the destination (save to) folder you created in the H:\ drive entitled Physical and insert the barcode for the Image Filename. ACTION 9: Click on Finish, then click Start to begin the process. ACTION 10: When the process is finished, click Close twice 28 Figure 40: When completed, click close. Page Figure 39: Creating physical image of disc. ACTION 11: Next, you will need to extract an archival copy of the logical image of the disc. The logical copy serves a listing of the data set and also a set of pointers which lead to the physical copy of the disc content. Please note that if the data from the physical copy changes, then these pointers on the logical copy may not point to the files properly. ACTION 12: After selecting Export Logical Image, you will be prompted to select the file folder where you wish to save the logical copy. Click, Add > Next (do not add any metadata)> H:\ > FTK_Images > [Barcode specific to item] > Logical. ACTION 13: Add the Image Filename (Barcode specific to item). ACTION 14: Click on Finish and allow FRED to run through cloning the logical image of the disc. When it is done with the Page 29 process you will see a screen which shows a fixity check/checksum for both SHA1 and MD5 algorithms. Fixity checks/checksums also known as hashes are meant to guarantee authenticity that the file has not changed from the time that it was cloned to the time that it is opened for use by an outside user 5.25” Floppy Disks PROMPT: New Items Have Arrived From BCCD that contain 5.25” floppy disks. ACTION 1: Select 10 books from the cart and bring them to the scanning workstation and follow the steps below. ACTION 2: Turn on the OptiPlex machine, use CNTL+ALT+DELETE and use the default Administrator login. No password is required. ACTION 3: Insert media into disk drive. Be aware that while the 5.25” is typically found on B:\, however the OptiPlex shows it on the A:\ Figure 44: Insert into drive. 30 Figure 43: Select item. Figure 42: No password is required. Page Figure 41: Turn on OptiPlex and select Windows NT. ACTION 4: Make sure that the drive latch is closed. ACTION 5: Open Command Prompt and My Computer from the Tangible Media Project folder on the desktop. Figure 48: Open My Computer to see all drives. 31 Figure 47: Open Command Prompt. Figure 46: Open the Tangible Media Project folder. Page Figure 45: Close the drive latch. ACTION 6: Open the C:\xcopy folder and create a new folder, naming it with the item barcode. ACTION 7: In Command Prompt, run the xcopy command to clone all files from the A:\ to the new folder you created on the C:\xcopy/barcode number and run a sequence of commands to capture all directories, subdirectories and hidden files. For more xcopy commands go to the Appendix. Example: Xcopy A:\ C:\xcopy/00012345678 /v /d /s /h /k In English: Run xcopy on the media in drive A, and then copy it to drive C in the folder xcopy, subfolder 00012345678. While running xcopy, verify content on media, find all directories, subdirectories and hidden files and copy everything. Commands used when running xcopy in Command Prompt /v = Verify the files are on the media /d = Copy all existing directories /s = Copy all existing subdirectories /h = Copy all hidden files /k = Copy all files on media 32 Figure 50: Run Command Prompt to clone all files from disk. Page Figure 49: Create new folder in C:\ ACTION 8: When the files have been copied successfully, you will see the number of files copied at the bottom of the file listing in Command Prompt. ACTION 9: Open the destination folder in C:\xcopy/[barcode] to verify that the files were cloned properly. ACTION 10: Find the designated flash drive and plug it into the back of the OptiPlex machine. to export files. Figure 54: Plug it into the back of the OptiPlex. 33 Figure 53: Use the designated thumb drive Figure 52: Verify files are in new folder. Page Figure 51: Files have been copied. ACTION 11: Copy the cloned content folder found on C:\xcopy ACTION 12: Paste the cloned content folder to the F:\ for transport to the Apollo portable hard drive. Figure 55: Copy the item folder with cloned files. Figure 56: Paste the copy into the flash drive. Page Figure 57: Bring flash drive and items to TMP3 station. 34 ACTION 13: Bring flash drive to the TMP3 station. ACTION 14: Copy cloned content to the Apollo hard drive (F:) into the folder named, Waiting for FTK. Figure 58: Copy cloned files to the "Waiting for FTK" folder. ACTION 15: Navigate to the RipStation shortcuts folder on your desktop, open 5_Media Scans (TIFs) and copy the corresponding TIF file to the new folder in Waiting for FTK. Then, transfer assembled files to the File ISO >With Page Figure 59: Add corresponding TIF file from TIF folder. 35 Pics folder. ACTION 16: In the RipStation shortcut folder, open the 6_TMP Tracking.xls file and update the item entry to reflect that the content has been cloned in X-copy and by whom. ACTION 17: Place completed items with media on the cart in the TMP1 station where they will be bagged and ingested into CTS. Page 36 ACTION 18: Delete the cloned files from the flash drive and return the device to the OptiPlex station. Acquiring Content Using FTK Imager Finding Content How to create both a Physical and a Logical Image of an optical disc (e.g. CD, DVD, etc.) when the RipStation has failed to do so, or when another problem arises. Logical Image-the copy that contains the full file structure (the data on the disc), but no information about the actual, physical drive. Physical Image-the copy that shows the disk, partitions, and file structure, as well as drive data (Instructions originally compiled by Rachel McPherson and updated by Kimberly Jackson). ACTION 1: Turn FRED on a. Press and hold the Power Button in the top left corner, then release. Note: the button may need to be held for a few seconds. ACTION 2: Open the program AccessData FTK Imager program. ACTION 3: Put optical disc in the BluRay BD-RE/DVD±RW drive. Note: disc may try to run using AutoPlay-exit if Page 37 necessary. ACTION 4: Click File-Remove all Evidence Items, or the Remove all Evidence Items button (if necessary). Note: This will clear any items that were not removed after a previous session. ACTION 5: Click File-Add all Attached Devices, or the Add all Attached Devices button. Note: Unless it is known what the disc or drive is specifically called, it may be easier to add them all and figure out which one is correct. D:\ Calliope –this is one of the swappable hard drives in FRED. G:\ CODEMETER [FAT32] –this may or may not appear, as it is the dongle that allows one to login to another program: the FTK5 Software. Typically only there if someone has been using FTK5 and hasn’t returned the dongle (looks like a USB flash drive) to the locked cabinet. Page 38 F:\ –this is typically the drive wanted. It will specify the name of the disc. Creating a Physical Image After you have created the logical disk image, you will need to proceed to the physical file copy. ACTION 1: Right-click on the F:\ ACTION 2: Select Export Disk Image… ACTION 3: The Create Image box will pop up. Click Add…, the Select Image Destination Box will pop up. Note: this will Page ACTION 4: Image Destination Folder: using the Browse button, find the folder where the files will be saved. 39 be the destination of the images after ripping. ACTION 5: Image Filename (Excluding Extension): enter in the barcode of the book (or whatever naming convention is decided), adding a “p” to the end of the barcode to differentiate it from the Logical Image that will be created later. ACTION 6: Click Finish. ACTION 7: The Create Image Box will appear. Make sure all options are checked (Verify images after they are created, Precalculate Progress Statistics, and Create directory listings of all files in the image after they are created). Page 40 ACTION 8: Click Start-the application will then proceed to create the Physical Image. ACTION 9: A message will appear that the Image Created Successfully. Page 41 ACTION 10: Click Close. The image will now be in folder you specified earlier. Creating a Logical Image ACTION 1: Right-click on contents listed under the F:\ ACTION 2: Select Export Logical Image (AD1)… ACTION 3: The Create Image Box will pop up. Click Add…, the Evidence Item Info Box will pop up. Page 42 Note: this is identifying info for the item, which is not needed at this time. ACTION 3: Click Next; the Select Image Destination Box will pop up. Note: this will be the destination of the images after ripping. ACTION 4: Image Destination Folder: using the Browse button, find the folder where the files will be saved. ACTION 5: Image Filename: enter in the barcode of the book (or whatever naming convention is decided). ACTION 6: Click Finish. ACTION 7: The Create Image box will appear. Page 43 a. Make sure all options are checked (Verify images after they are created, Precalculate Progress Statistics, and Create directory listings of all files in the image after they are created). ACTION 8: Click Start-the application will then proceed to create the Logical Image. b. A message will appear that the Directory Listing Created Successfully. Note: After the image has been created successfully, the hashes will be displayed to show that the image was unaltered in the copying. ACTION 9: Continue to click Close until all pop-up windows are closed. The image will now be in folder you specified earlier. ACTION 10: When creation of both Physical and Logical Images is complete, eject the optical disc by right-clicking on the disc (located on your computer’s Desktop) and select the Eject option. ACTION 11: Click File-Remove all Evidence Items, or the Remove Page 44 all Evidence Items button to prepare for the next item. Acquiring Content Using Command Prompt/XCopy FRED FRED OptiPlex Page FRED 45 Many items that come through PRD for the Tangible Media Project are CDs and DVDs and may be ripped successfully using the Ripstation workflow. However, there are several items that arrive for preservation reformatting which contain obsolete media that cannot be ripped. In this case, you will need to run Xcopy in Command Prompt in order to clone the files. The list below shows what types of media should be cloned using Command Prompt on a specific device in PRD. Assembling Content for CTS After you have scanned a TIF image of the item media and ripped or cloned the content, you must assemble the files together so that they can be bagged and then later ingested into CTS. Most of the CD/DVDs that you rip will produce an ISO-9600 file type. However, the media may also rip an MDF/MDS file and even more file types if the media had to be cloned using FTK or Xcopy. Below are scenarios that you should look for in the various circumstances. Overall, a complete assembled file should contain the following regardless of ripped file types: Standard ISO with TIF Standard ISO with Multiple TIFs Multiple ISOs and Multiple TIFs MDF/MDS file with TIF 46 TIF(s) of media scanned on flatbed Media content (regardless of file type) Unzipped media content (for ISO files) Page Multiple ISO, MDF and TIFs BIN/CUE, ISO and TIF BIN/CUE, multiple ISO fragments and TIF Multiple Media Items with BIN/CUE, ISO and TIF Page 47 Varied File Types (FTK/Xcopy) and TIF CTS Ingest (post-ripping) Once the materials are ripped, the labels scanned, and the metadata prepared, there remains the need to transfer the digital files to the CTS system. Using the FileZilla application, authorized users may log in to the sun9 server, where the files are put for ingest into the CTS long term storage system. After FileZilla opens, select “File, site manager” as shown below. After initial use, most the information will not need to be entered again. The Host is the sun9, where PRD archives its digital files. Servertype is should be SFTP-SSH File Transfer Protocol. The Logontype should be “Ask for Password.” The user will have to be authorized to logon to CTS. The password will be provided when the user authorization is given. Page 48 Once logged in one find the following screen, depending upon the machine used. The following example was taken from LSH5ZJLC1, one of the machines with a Ripping Station attached in the DPL work area in PRD. Note the yellow line down the middle of the screen. On the left hand side are listed local and network directories where the files were ripped. On the right side of the screen are directories on the server to which the directories and files are being moved. Page 49 The red dot on the left shows the Apollo drive (E:BCCD\FilesISO\WithPics) where ripped files with pics are stored. The red line lists all the directories ripped named after their barcodes. The right side shows the home directory of whatever user has logged in. (red dot right) It is necessary to change directories on the right to locate the directory where the files should go for transfer to CTS. The directory for transfer of Tangible Media files to CTS is /sh_ingest/tangmed/prd/staging, and it may be reached by typing it in on the right (see red dot) and hitting enter. Page It may take several minutes for the files to transfer, depending upon how much information was on the ripped CD or DVD. Once the files are transferred, the permissions need to be changed on the CTS server, so they can be moved to their final location. To do this, right click the mouse on the right side to make the following menu appear. Check all the permissions boxes as shown, including “Recurse into subdirectories and “Apply to all files and directories” near the bottom of the menu. Check ok. It may take a minute or longer before the permissions are changed. 50 Once in the proper directory (//sh-ingest/tangmed/prd/staging), one may right click on a directory on the local drive, on the left and a pop-up menu will appear. Select “Upload”. Page 51 Lastly, if confident that the files transferred, delete the directory from the left hand side of the screen so the hard drive we rip to doesn’t fill up. Log off the sun9 by closing FileZilla. The CTS system is entered from the URL: https://cts.loc.gov/transfer/login/login_form.html, or just https://cts.loc.gov. Users must have an account. The username is the same as the login to the LIB network, as is the password. CTS recommend that Firefox be used to connect to CTS. After logging in, select, “Start”, then “Multiple receives” as shown below: The Multiple Receive screen will come up. It looks like the following: A long screen as following will appear: Page 52 Note the red dots. The Project for DVD and CDs is called “PRD Digital Content”. The storage system is “sun9”. The file path it should be set to is /sh_ingest/tangmed/prd/staging”. If all this information appears, click “Submit”. Page 53 Typically, no fields here need to be changed, except for the bag-info.csv (see red dot). Click on the “Browse” button by the red dot. Find the .CSV file on the OptiCopy drive (\\lcdat3\preserv\prd) (See red dot) and select it, and open it. This contains metadata that provide information about the directories we are adding to CTS. Page Note the red dots. Click on the boxes next to the items you are ingesting into CTS, the ones listed on the .CSV file you associated with them by browsing on the last screen. Then click the green button “Start” at the bottom of this screen. It will take CTS some time to process the items. It will report that N number of workflows have started, which will confirm that the ingest is working. 54 A list of all the files ready or already being processed in CTS will appear. It can take several hours for the files and directories to be ingested, depending upon the load on the system and file sizes. The final step to ingesting items into CTS is to verify that a “best copy” has been received, and to add metadata tags, if necessary. The barcode for the item in question can be searched or scanned with a barcode reader. (Red dot at top right) The information about the item is displaced. If the ingest was successful, a “long-term storage best copy” will be listed (Red dot below). By clicking on “Tags” (red dot middle) a list of metadata tags may be seen, and edited as needed. Page After a best copy is received, the PRDArchive application is run to update the catalog record to show that CTS has a best copy in the digital archive. This application is currently available on LS2PS9QG1 in the PRD. It is a very simple application, and works with a barcode scanner, or the barcodes can be typed, if necessary. A login and password for Voyager are needed. 55 By right clicking at the red dot, one may change or add metadata. A drop down list will appear and metadata tags may be selected from that list. One example would be “MDF/MDS Image” which is a type occasionally found in the workflow of ripped discs, although less often than ISO9600 image. Once the application login is complete, a simple screen with a window for typing appears. Scan or type in the barcode and the process begins. Once complete, the window will turn green. This means that the catalog record has been altered to add the text “Tangible Media Preservation Project” so staff may know that we have archived a digital copy of the CD or DVD in the CTS system. Below is an example of what altered record will look like once the process is completed. Page 56 Note the red dots by the 985 field of the MARC record. The phrase “Tangible Media Preservation Program” has been added. Once this process is complete, the books with discs may be put on the cart for MRC pickup. APPENDIX Barcode Errors When you select an item, the first thing you need to do is check for the presence of an LC barcode on the back cover. If there is no barcode present, you must search the Voyager catalog for the item to see if there was ever a barcode assigned. No barcode in Voyager assigned to item? Give to Adrija to create a temporary barcode for the item. Place item back into the workflow. Barcode assigned in Voyager? Return to Cliff in BCCD with a status slip checked off with “Barcode Missing.” He or his team will add a barcode and return to PRD to be reintroduced to the Tangible Media Project workflow. Unzip Errors There may be times when you rip a CD/DVD or a mini disc and which contain .iso files and find that you receive an error message when attempting to unzip them. The archive file may be compressed using a newer format than what is supported by the version of WinZip currently installed. Please check the WinZip website to see if there is a newer WinZip version that may be able to open the archive. The archive file does not exist or is in use by another program. The specified folder does not exist. The file is not an archive. The archive has been damaged or corrupted. There were disk errors or insufficient memory while reading the archive. The archive contains invalid or illegal filenames. The Zip file does not conform to the Zip standard and contains non-standard data. Page 57 This message is displayed if WinZip® was unable to open the requested archive. Specific causes for this error include: If you are working with a Zip file, you can try repairing the file as described in Fixing Zip Files. If you are attempting to open an IMG or ISO file, please note that WinZip includes support to read and extract from ISO files and disc image IMG files. Many programs use the IMG file extension for what they would term "image data". In such a case, the "image" may be a graphic or it may be a digital image of a disc (or diskette). Attempting to open an IMG file that is not in the expected ISO format is one way to cause WinZip to display this error. WinZip supports ISO file systems that include ISO 9660 and UDF from 1.02 to 2.6 (a subset of ISO 13346). Usually, CD images use ISO 9660, DVD images use UDF1.02/ISO9660 bridge, and Blu-ray Disc images use UDF 2.5. Status Slips The status slips are used to keep track of errors and missing actions. The only time you will need to use a slip for an item is when there is a problem, error, or missing action that is still needed. The template for the status slip is located in: M:\PRD\OptiCopy\BCCD-MRC\_Instructions\Status Slips Tracking Spreadsheet It is important to note that the tracking spreadsheet is used to not only track the actions performed on each item, but that the metadata collected on this sheet is also used to assist with bagging the items in a CSV format. Therefore, it is critical that each item has a complete record before it is considered “complete.” While tempting, you must not enter your name for the completed by sections until the action is truly complete. Entering this information before the action is complete can lead to errors or extra work later. Each item (book with media) should have its own line and contain the following information: bag_id Barcode_id Scanned-By Ripped-By FTK’d-By XCopy-By Assembled-By Page In rare circumstances, someone else may have the spreadsheet open at the same time as you. In this case ONLY, you may create a copy, delete all previous entries from the COPY ONLY, and then enter your new information in that copy. Before walking away from the project, or leaving for the day, be sure to copy and paste all of your new information into the ORIGINAL spreadsheet when it is again available for use. 58 Important to Note XCOPY Parameters/Commands Control + C: Immediately cancels current activity. /w : Displays the message “Press any key to being copying file(s) and waits for your response before starting /d: Copies the directory structure. /p: Prompts you to confirm whether you want to create each destination file /c: Ignores errors /v: verifies each file as it is written to the destination file to make sure that the destination files are identical to the source files /q: suppresses the display of xcopy messages /f: Displays source and destination files names while copying /l: displays a list of files that are to be copied /g: creates decrypted Destination files when the destination does not support encryption /d [:MM-DD-YYYY]: copies source files changed on or after the specified date only. If you do not include this value, xcopy copies all source files that are newer than existing Destination files. This option allows you to update files that have changed. /u: Copies files from Source that exist on Destination only. /i: If Source is a directory that contains wildcards and Destination does not exist, xcopy assumes Destination specifies a directory name and creates a new directory. Then, xcopy copies all specified files into the new directory. By default, xcopy prompts you to specify whether Destination is a file or a directory, when Destination does not already exist. /s: Copies directories and subdirectories, unless they are empty. If you omit /s, xcopy works within a single directory. /e: copies all subdirectories, even if they are empty. Use /e with the /s and /t command-line options. Page /k: Copies files and retains the read-only attribute on Destination files if present on the Source files. By default, xcopy removes the read-only attribute. 59 /t: Copies the subdirectory structure (that is, the tree), not the files. To copy empty directories, you must include the /e command-line option. /r: copies read-only files. /h: copies files with hidden and system file attributes. By default, xcopy does not copy hidden or system files. /a: copies only Source files that have their archive files attribute set. /a does not modify the archive files attribute of the source file. /m: copies Source files that have their archive attributes set. Unlike /a, /m turns off archive file attributes in the files that are specified in the source. /n: creates copies by using the NTFS short files or directory names. /n is required when you copy files or directories from an NTFS volume or when the FAT file system naming convention (that is, 8.3 characters) is required on the Destination file system. The Destination file system can be FAT or NTFS. /o: copies file ownership and discretionary access control list (DACL) information. /x: copies files audit settings and system access control list (SACL) information (implies /o). /exclude: FileName1[+[FileName2][+[Filename3](...)]: Specifies a list of files. At least one file must be specified. Each file will contain search strings with each string on a separate line in the file. When any of the strings match any part of the absolute path of the file to be copied, that file will be excluded from being copied. For example, specifying the string, \obj\ or .obj will exclude all files underneath the directory obj or all files with the .obj extension. /y: suppresses prompting to confirm that you want to overwrite an existing destination file. /-y: prompts to confirm that you want to overwrite an existing destination file. /z: Copies over a network in restartable mode. /b: copies the symbolic link instead of the files. Parameter introduced in Windows Vista. /j: Copies files without buffering. Recommended for very large files. Parameter introduced in Windows Server 2008 R2. Page 60 /?: displays help at the command prompt.