This book introduces fundamentals and trade-offs of data de-duplication techniques. It
describes novel emerging de-duplication techniques that remove duplicate data both in storage
and network in an efficient and effective manner. It explains places where duplicate data are
originated and provides solutions that remove the duplicate data. It classifies existing
de-duplication techniques depending on size of unit data to be compared the place of
de-duplication and the time of de-duplication. Chapter 3 considers redundancies in email
servers and a de-duplication technique to increase reduction performance with low overhead by
switching chunk-based de-duplication and file-based de-duplication. Chapter 4 develops a
de-duplication technique applied for cloud-storage service where unit data to be compared are
not physical-format but logical structured-format reducing processing time efficiently.
Chapter 5 displays a network de-duplication where redundant data packets sent by clients are
encoded (shrunk to small-sized payload) and decoded (restored to original size payload) in
routers or switches on the way to remote servers through network. Chapter 6 introduces a mobile
de-duplication technique with image (JPEG) or video (MPEG) considering performance and overhead
of encryption algorithm for security on mobile device.
