Hyperspectral Imaging of the Waldseemuller 1507 World Map

Scientists, Scholars, Scriptospatial:
Visualization and Integration of
Digital Humanities Data
Dr. Fenella G. France
Chief, Preservation Research and Testing Division
Library of Congress
Integrating Science & Humanities Scholars
• Preservation of original historic materials is critical to
preserving the “hidden” information
• Blending science and humanities enhances our
capacity to understand provenance, author intent, and
enrich understanding of materials
• Developments in noninvasive and digital technologies
have advanced the capture of scholarly content
information, integrating science and scholars
• Scriptospatial mapping of documents creates a new
tool for scholars and researchers
Library of Congress
Preservation Directorate
Mission:
“To assure long-term uninterrupted access
to the intellectual content of the Library’s
collections, either in original or
reformatted form”
Library of Congress collections number over
158 million items (838 miles of bookshelves)
(more than 36 million books and other print materials,
3.5 million recordings, 13.7 million photographs, 5.5 million maps,
6.7 million pieces of sheet music, 69 million manuscripts)
Non-Invasive Analytical Technologies
• Optimize the preservation of humanities sources
• Enable scholarly and forensic type analysis of
materials
– Paper, parchment, inks, colorants
• Capture hidden/lost content, provenance
information
X-ray fluorescence (XRF)
Hyperspectral Imaging
μ-Raman
Non-invasive Imaging Technologies
• Visible and non-visible spectral information
becomes content “knowledge”
• Accurate digital renderings of historic materials
create a new “digital cultural object” with
access to previously unknown information
• Technologies could not be utilized without
preservation of the original humanities materials
• Digital data allows a balance between
preservation and access to new content
Spectral System Specifications
• 39 megapixel monochrome camera
– Kodak CCD sensor (7216 × 5412 pixel array with
linear dimension of 6.8 microns)
– E6 back, APO-Digitar 5, 6/120 lens (UV enhanced)
– Integrated with light emitting diode (LED)
illumination panels
– 365nm to 1000nm spectral range (UV, VIS, NIR)
• Reflected, transmitted and raking (sidelighting) illumination modes
• Fully registered images (no filter pixel shift)
LED Illumination Sequence
Ultra-Violet
NON-Visible
• 365 nm
• 445 nm
• 470 nm
• 505 nm
• 530 nm
• 570 nm
• 617 nm
• 625 nm
• 700 nm
• 735 nm
• 780 nm
• 870 nm
•940 nm
•1040nm
Visible
Infrared
NON- Visible
• 445 nm raking
• 910 nm raking
Image cube (stack) of registered spectral wavebands
X, Y, Z
Processing (Principle
Component Analysis
- PCA etc.)
Combinations of some/all
bands
UV, VIS, NIR
Screen Capture of Photoshoot Customized Software
Create Pseudocolour Image
to Enhance Features
Full Spectrum Colour
Pseudocolour
Jefferson’s Handwritten Draft of the Declaration of Independence
Subtraction of bands 10-5 (NIR – green visible) image inverted, with overlay
a. Difference between 2 bands (IR
and visible) difference imaging
and ratios between wavebands
b. Cropped version of (a)
c. “Otsu” multi threshold technique
to enhance different intensity
ranges
d. Assigning pseudo color (remove
transition edges from (c)
e. Joining the dots - pseudo color
(artistic interpretation)
f. Removed citizen for clarity of
viewing (make equal to
background text)
James Madison Debate Papers 1787
JMD10E
or any treaty subsisting under the authority of the union [see Part’s
L’Enfant Plan of Washington
D.C. (1791)
Asspectrum
seen in the infrared
In the visible
Spectrally Different Pencil Annotations:
Jefferson and ?
Out
Struck
Insert
of height
Fourier base spatial filtering to remove periodic
horizontal banding of laid paper
Integration With Other Analyses
Spectral imaging mapping of document prior to
non-invasive scientific analyses
• Reflectance spectroscopy
• Fourier-transform infrared spectroscopy
(FTIR)
• X-ray fluorescence (XRF)
• Raman spectroscopy
• ESEM
Gettysburg Address (Draft 1 - 19 Nov. 1863)
Ultra-violet (365nm)
Gettysburg Address – Nicolay Copy
22
Gettysburg Address – Nicolay copy – Principal Component Analysis
Portolan Charts: 1320-1633
Vellum
nautical
manuscripts
Mediterranean ( 1320)
Mediterranean & Western
Europe (Prunes) (1559)
Europe and the Mediterranean (1484)
Central & South America,
Pacific Coast (1565)
Mediterranean & Western
Europe (1633)
Questions:
•Did colorants relate to availability in geographical region?
•Evidence of trade routes?
•Determine if colorant relevant to time period
Stitching “Registered” Image Cubes for High Resolution Images
[00]
[10]
1320
Chart 628
dpi
Total
approx.
size
24” x 36”
[01]
[02]
[11]
[12]
10
09
1320
Chart
1660 dpi
01
00
11
03
02
08
04
05
07
06
Non-Invasive Spectral characterization (no sampling) Portolan Charts 1320
Matching the spectral response on the chart with a pigment reference sample
Center for Library Analytical Scientific Samples (CLASS)
• Range of characterized library reference materials
• Creation of natural and accelerated aged samples
• CLASS-D: standardized digital data for sharing /access
Layering of Lines and Text on Charts
Enhancement of Lost / Obscured Text
PCA, 13 bands, bands 2-3-4
PCA, 13
bands, bands
3-5-3
Detecting Changes due to
Environment and Treatments
• Environments:
• Storage
• Exhibition (light-sensitive materials)
– Environmental Parameters:
•
•
•
•
Relative humidity
Temperature
Light
Pollutants
• Treatments
The Herblock Political Cartoon Collection
Preservation of Twentieth Century Fugitive Media
Herblock Political Drawings
Isn’t this better_2001
Watermark Imaging
Reflected and transmitted illumination
Dunlap Broadside (early printing of Declaration of Independence)
Reflected – Visible Illumination
Transmitted Illumination
Specialized
processing
to “remove”
text but
retain chain
and laid
lines and
watermark
Verin Noravank Gospels (1487)
This Armenian
manuscript contains one
of the rare allusions to
Yaqub, the leader of the
Aq Qoyunlu (White
Sheep Turcomans), who
ruled much of the eastern
parts of historic Armenia
The original format of the book
Provenance
“I wrote this manuscript as
a pledge which I undertook
at Verin Noravank.
I dedicate it to Father John,
Gohar, Saint Mary, and
[others.]
This Holy Gospel was
written and illuminated in
1487 by the undeserving
and unskilled scribe, Grigor
Abegha”
Book construction:
Page preparation
Description
Folio 126
Gospel of St. Mark
Two illuminated pages : Gospel of Mark: left page: Folio 77 verso; right page: Folio 78 recto
Armenian
Painting
Technique
Analysis
of Armenian
Painting
Techniques
Color chart,1723 A.C.E.
grey
green
white
yellow
red
blue
black
Painting by T. Ohanyan, 2010
Armenian Painting Technique
Drawing by T. Ohanyan, 2010
Armenian Painting Technique
Painting by T. Ohanyan, 2010
Facsimile of Original Colours cf. Original
Technical Analysis of the Illumination
of St. Mark
XRF:
Smalt
Raman : Ultramarine
reference spectrum
Sample spectrum
Reconstruction of Grigor Abegha’s Palette
Oranges, Reds, Brown and
Magenta: mixtures of red lead,
vermilion and orpiment, and
organic red lake
Blues:
ultramarine/
smalt mixture
Whites: rare
example of tin
white
Yellows:
orpiment
Greens:
orpiment/ indigo
mixture
Rebinding
Use of Traditional Materials
Final Product
Yasmeen Khan and Tamara Ohanyan
Ptolemy, Geographia, 1513,
Lessing J. Rosenwald Collection,
Rare Book and Special Collections, Library of Congress
Approximate dimensions:
45.5 x 32.7 x 5.9 cm.
Approximate dimensions (map open):
44.0 x 60.0 cm.
First section containing Ptolemy-based text and maps
Second section containing text and maps based on
European discoveries up to early 16th c.
Front pastedown
False-color hyperspectral image
of erased inscription
Record from the Rosenbach Museum & Library
Front pastedown
False-color hyperspectral image
of erased inscription
Rosenwald 1513 edition of Ptolemy’s
Geographia
Questions:
Green pigment identification?
Why are only 7 of 47 hand-painted maps in poor condition?
Determining Provenance
Central Guard
Guard placed
over sheet of
Arches paper
Mould paper (1925)
Rosenwald 1513 edition of Ptolemy’s Geographia
Green in
gutter in
good
condition
Green on
map in
poor
condition
(muddy)
Offset from green
pigment
Questions:
Green pigment: verdigris deterioration? but more?
What is causing the poor condition of
7 maps?
Reconstruction of Treatment History:
XRF Analysis of Paper Substrate
x 1E3 Pulses
Ca
K
6
Blue = good condition
Red = poor condition
Grey = background spectrum (air)
Ca
KAl(SO4)2,
potash alum
4
Fe
Cu
S
UV image of
brushstrokes
2
K
Fe
Cu
S
Cl
Mn
0
2
4
6
- keV -
8
40 kV,1020µA
A
C
B
Ptolemy Geographia Map 119-120,
Yellow Pigment Areas of interest (After treatment)
Imaged 4.6.2012
Fluorescence comparison, Map 119, Blue
Imaged 11.29.2012
A
B
C
Map 115-116, Changes in Paper
Areas of interest
Waldseemüller 1507 World Map
PCA Pseudocolor
of Red
Red Grid
Enhancing
Faded
GridLines
Lines
Creation Techniques: Rendering of what original wood block might have looked like
Ptolemy
Watermarks and Paper Quality
Crown watermark
Fleur de lys watermark
Un-watermarked laid paper
Three types of paper related to range of conditions of the maps
Crown watermark
Crown watermark
Map with a Crown watermark
Waldseemüller Crown watermark
Geo-spatial Linking of Data
Strasbourg
c. 1507–1512
Pause project to print
Waldseemüller world map;
Duke René and Ringmann
unexpectedly die
c.1512 on
Waldseemüller and
Schott relocate and
finish new edition of
Geographia
1520
1512
1507
1506
St. Dié
c.1506
Waldseemüller,
Ringmann, Lud, and
possibly Schott gather to
print a new edition of
Geographia
c.1520 on
1513 maps hand colored
and bound with a 1520
copy of Tabula Nova
Helvetium
Distance between locations: 84km
Exhibit in Jefferson Building, Library of Congress
Access: Data Organization and Integration
“Scripto-Spatial”
A GIS system for documents
• Link data within and across collection items
• Temporal, spatial and layering of data
• Visualization and representation of scientific
data to interpret:
• Materials characterization
• Identification, Geographical, Chronological, Use of Materials
• Development of new object creation techniques
• Enhanced lost / obscured information
• Linking preservation and interpretation of data
Paper fiber with
ink particles
Transmitted Light Microscopy
Scripto-Spatial “mapping”
Mayan Flasks, Late Classic (600-900 AD)
• Flasks filled with an unknown red pigment
• Probably cinnabar (HgS ore) or hematite (Fe2O3)
• Loose fragments of pigment in storage containers taken for analysis
X-Ray fluorescence of pigment
- Samples were Fe based pigments
- Samples had trace amounts of titanium
Evidence for Provenance
Titanium dioxide can be
found in two forms
Potential evidence of
trade routes
Detection of Previous Historic Reconstruction
Frederick DeWit Atlas
ca. 1860
Rosenwald Collection
Rare Books and Special
Collections
Frontispiece
Detail of verso of Map of America with ink
inscription and tabs
Nova Orbis Tabula (World Map)
Map of America
Blue Colorants
Frontispiece, blue in clouds
World map (upper left)
detail in border showing
bright yellow over blue over
pale yellow
World map (upper right)
light blue overpaint with
craquelure
Map of America,
blue hat
Map of America, blue scarf
Blue Colorants
World Map
Elements Detected:
Copper, lead, iron silicon,
potassium, traces of mercury,
sulphur
Suggested Identification:
•Azurite (traditional copper
carbonate)
•Lead white
XRF spectra of blue colorants in World Map
•Iron ochre, organic yellow,
ultramarine (natural or
synthetic) indigo, verdigris
Blue Colorants
Map of America
Elements Detected:
Copper, cobalt, tin, iron, silicon,
traces of lead, chromium,
mercury, zinc (arsenic and
nickel)
Suggested Identification:
•Azurite (traditional copper
carbonate)
•Smalt, (traditional cobalt
containing glass pigment)
XRF spectra of blue colorants in Map of America
•Cerulean blue
Red Colorants World Map
Red Colorants
World Map
Elements Detected:
Mercury, lead, cadmium, selenium,
iron, sulphur, barium, potassium,
cobalt, silicon
Suggested Identification:
•Vermillion
•Red lead (traditional)
•Lead white additives in pinks)
•Cadmium red lithopone in some
areas (1926 and later)
Evidence of Previous Restoration
CLIR/Mellon Fellowship
Federal Theater Project Research (Amy Brady)
Bartók’s Final Concerto for Orchestra
Segesser Hides (reposteros), ca.1740, Palace of the Governors, Santa Fe, NM
Under-drawings
IRENE: Image Reconstruct Erase Noise Etc.
IRENE (non-contact) system for historic machine readable media
developed in collaboration with Lawrence Berkeley National
Laboratory to image the surface of grooved recordings
Worn and Damaged Shellac 78rpm Disc
Johnny performed by Les Paul and Mary Ford,1953
Played with stylus
Played with 2D IRENE
Johnny is the boy for me
Always knew, that he would be
But I never caught his eye
He would always pass me by
Never had a glance for me
Though I loved him [skip] from the start
And I told my eager heart
Johnny is the boy for me
Broken Wax Cylinder
Song from the ritual of the White Buffalo Hide
sung by Wa-kon-mon-thin.
Recorded in September 1895 by Francis LaFlesche
(an Omaha/Ponca tribal member and adopted son of
Alice Fletcher)
Folklife Center Collection
Fletcher 25
Played with 3D IRENE
Center for Library Analytical Scientific Samples (CLASS)
CLASS-D Digital Framework
Assessing longevity of storage / audio-visual historic and modern media:
e.g.CDs, thumbdrives, hard drives, magnetic tape)
• Open source software architecture / platform
– Customized Resource Description Framework
• International access to data with data
interoperability; standardized file formats
• Wide range of reference materials
– New, naturally & accelerated aged samples
– Physical (reference papers, books – Barrow collection,
pigments, leather, stone, fibers etc)
– Digital files associated with collection objects and
reference samples
(hyperspectral images, FTIR, Raman, XRF, SEM etc)
CLASS-D Database Architecture
Scripto-Spatial “mapping of documents”
Summary
• Importance of preservation of the original so
new technology can be applied to recover lost
information, confirm provenance
• The “digital cultural object” links new nonvisible content information with the original
• Scriptospatial – new visualization processes to
integrate related scholarly daya
• New technologies enhance the content of
collections, utilizing science for humanities
and encouraging effective collaborations
“Custodians for future generations”
Acknowledgments:
Special Collections Curators and Staff
Preservation Research and Testing Division Staff
Conservation Division Staff
frfr@loc.gov