Università degli Studi di PaviaCentro Interdisciplinare di Bioacustica e Ricerche AmbientaliVia Taramelli 24 - 27100 Pavia - Italye-mail : cibra@cibra.unipv.it The history of the CIBRA Digital Signal Processing WorkstationBefore the establishement of the Centre in 1989, bioacoustic
research has been carried out at the Institute of Entomology. The activities
began in 1980 with the developement of a computer based digital spectrograph.
The first one in Italy dedicated to the study of animal vocalizations;
it was developed within my thesis for getting the degree in Natural
Sciences.
This system allowed the first experiments of digital
analysis on animal sounds in Italy. A series of programs was developed
to perform a number of different tasks, including: acquisition of up
to 60K samples (six 10K samples consecutive frames by means of pre-
and post- triggering facilities available on the B&K analyzer),
signal storage and retrieval, signal editing, waveform and envelope
display, instantaneous spectrum and cepstrum, formant analysis, signal
filtering by means of FFT forth and back transformation, spectrogram
on up to 10K samples, frequency tracking, 3D waterfall display.
In the first version of the software, a monochromatic spectrogram on 10K samples (0.2 sec duration and 20kHz bandwidth at 51200 s/sec) required 40 minutes to be computed and displayed. Later, the use of a Tektronix FFT ROMPACK with optimized FFT routines allowed to reduce the computation time to about 15-20 minutes for each 10K block. Initially, the programs were mainly used for experimentation, bird song analysis and microseismic studies. In 1984 the first analyses on fish sounds (recorded at the University of Parma by Prof. Patrizia Torricelli) were made and opened the pathway to underwater bioacoustics.
In 1985, after getting the degree in Natural Sciences in 1983, the programs were rewritten in FORTRAN on a HP 1000 (128K RAM, 5MB removable HD, 10 bit AD converter, 512x512 pixels color graphic display) made available by the Dept. of Electronics of the University of Pavia. I am very grateful to Prof. R.Schmid, chief of the Department in that period, for having allowed me to use all the instruments without any restriction. That powerful instrumentation allowed the development of several new procedures, including continuous signal acquisition and HD recording, easy and fast signal retrieval and display, colour spectrograms, color manipulation on displayed images, wider control on analysis parameters, moving cursors to take measures on the spectrograms (time, frequency and dB readings), and, overall, speed! Few minutes to get a 0.625s spectrogram! While developing software on that system, I had the honour to see at work a Laben computer with 16Kbytes of "ferrite doughnut" RAM, a paper tape reader for programs and data I/O, an oscilloscope for graphical output.
Envelope display for signal retrieval and colour spectrogram of a signal frame (1985). The emerging Personal Computers, even if limited in
their performances and very expensive - more expensive than a car -,
suggested me to start developing a personal sound analysis system. In late 1986 a further definitive leap towards the emerging PC architecture: an Olivetti M24 (Intel8086 CPU, i8087 FPU, 8MHz, 256K RAM, 20MB HD, an EGC graphic board with 640x480 pixels and 16 colours) equipped with a Data Translation DT2801 signal acquisition board (27ksamples/sec maximum sample rate, 12 bit AD converter, DMA) for sound I/O. Just to get few % of speed increase I replaced the Intel CPU with a compatible NEC CPU.
Spectrogram of courtship sounds emitted by the goby fish Padogobius martensi made on a 8086 PC (1986) Rewriting the whole software, as well as optimizing
it for the new hardware, was a big challenge. I spent a lot of time
to make it running. I was very lucky to find a wonderful book ("8087
Applications and programming for the IBM PC and other PCs" written by
R.Startz, published by Brady in 1983) and after reading it I gave a
boost to the software by writing most of the critical routines in Assembler
8086 and 8087. Then, the shell of the program and the user interface
were written with the Microsoft Basic Compiler and subsequently with
Microsoft QuickBasic, one of the first compiled procedural Basic available
for PCs. With this new system I began to work extensively on many animal species, including marine mammals. Also, I began to experiment with song parsing, frequency tracking and automatic analysis of song parameters. The very first attempts were very successful because I tested the algorithms on very good recordings of relatively simple songs... though, I discovered very how much complex "real world recordings" can be...
A dedicated driver was developed to print on LaserJet
printers The first real-time portable system to be used in
the field was developed in 1990 by integrating in a portable PC (EPSON
PC AX3s Portable, 8086SX + 808387, 16MHz, 2MB RAM, 40MB HD) a high
quality audio board along with a DSP based signal acquisition board
Microstar DAP 2400 (12 bit AD, max 250K samples/sec, a Motorola DSP
56001 and an Intel CPU on board) for real-time processing and high
speed data acquisition. The system was called Portable DSPW - Digital
Signal Processing Workstation. |
|
The Portable DSPW with the base to host
Scheme of the desktop DSPW |
|
Screen shot from the real-time Duetto Spectrograph based on the Audiologic board (1993) Another experimentation made possible by real-time processing and display capabilities, was joining video to audio and spectrograms. A desktop PC was fitted with a video overlay board and a sound acquisition board to show a live video on the PC screen along with a real-time spectrogram. The system was later modified by adding a VGA to video converter and a video mixer to produce video tapes integrating a HiFi sound channel, a live video and a real-time spectrogram. This system was extensively used at the Genova Aquarium to study the vocal behaviour of a newborn bottlenose dolphin and to associate sounds with visible behaviours.
Real-time spectrogram with a live video of a vocalizing young dolphin (1994, research made at the Genova Aquarium) The introduction of Pentium processors definitively moved
the PC into the real-time arena.
The latest version of the SBRTA software (1996), still available for free download. Since then, the continuous increase in CPU speed made the analysis of sounds faster and faster. In 1996, a Pentium 233 required only 200 msec to display a spectrogram of 1 second of sound sampled at 48000 samples/sec thus making it possible to work in real-time up to 250K samples/sec. Other than speed increase, the latest development of multimedia PCs offer a wide range of powerful audio interfaces with disk storage capacity increasing month by month. The high quality audio interfaces now available for both desktop and notebooks PC now outperform even the DAT recorders and allow to setup a powerful sound analyisis and recording system on a notebook.
Then, in year 2000, with the new windows based software, named wSpecGram, the fast Pentium CPUs, the high quality sound devices made available by a globally expanding market of multimedia products, the hard disks able to hold up to 100GB, it was possible to do almost everything on a cheap notebook: multichannel sound recording and real-time display, recording and analysis of ultrasounds up to 400 kHz, and to think to new challenges such as realtime beamforming, sound localization and sound classification. A PII 233MHz notebook with the very first USB digital audio interface made by OPCODE and a DAT SONY D7 (1998). A whole bioacoustic laboratory in a notebook. A dream become true. The features of the current version of the Digital Signal Processing Workstation are described in the pages on the equipment and software developed by CIBRA. Page created by G.Pavan, 2001. Revised March 2005. |