The VisiSonics 5/64 Audio/Visual Camera

VisiSonics 5/64 音視頻聲學(xué)相機

The VisiSonics 5/64 Audio/Visual Camera consists of 5 video cameras and 64 microphones mounted on the surface of an aluminum sphere. The spherical architecture and associated algorithms allow the creation of an omni-directional acoustic image of the environment. The 5 HD video cameras simultneously generate an associated omni-directional panoramic video stream of the captured environment. Audio and video are synchronized and co-registered as a combined stream using patented algorithms. The convergence of audio and video capture allows for the visualization of sound sources and their interaction with the environment to be understood in real-time.

VisiSonics 5/64 音視頻聲學(xué)相機由5個攝像機和64個麥克風(fēng)組成，安裝在一個鋁合金球體表面。該球形結(jié)構(gòu)和相關(guān)算法精準地復(fù)原了環(huán)境全景聲像圖，該5個高清視頻攝像頭同步工作從而捕獲了全方位的環(huán)境視覺景觀，采用了獨特的專利算法能使音視頻完美地結(jié)合起來，音視頻的同步獲取實現(xiàn)了聲源的可視化，并且能對環(huán)境狀況進行實時解析。

With the “Audio Camera,” and the FINDr software, users can capture, store, retrieve and process real-time integrated and synchronized audio and visual information. The captured data incorporates all aspects of the audio-visual world that an individual would experience if he or she were physically present where the Audio/Visual Camera were located. The processing software and storage system allows you to do this in real-time or to record sessions for post analysis.

使用聲學(xué)相機和FINDr 軟件，用戶可以錄制、存儲、檢索和處理實時集成和同步音視頻資料，捕獲的數(shù)據(jù)包含了音視頻的全部信息，如果他或她在現(xiàn)場則能深刻地體驗到這些。處理軟件和存儲系統(tǒng)能夠讓你實時地做這些事情，也可以錄制下來供事后分析。

Audio Camera Applications

聲學(xué)相機應(yīng)用

·Noise Source Identification

噪聲源識別

·Ambisonics

環(huán)境高保真度立體聲

·Architectural Acoustics and Room Measurement

建筑聲學(xué)和室內(nèi)音質(zhì)測量

·Telepresence

遠場呈現(xiàn)

·Cross-Modal Attention and Saliency

跨模式備注和顯著性

·Psychophysics

心理物理學(xué)

·Audio-Visual Tracking

音視頻跟蹤

·Audio/Visual Recording and Analysis

音視頻記錄和分析

·Meeting Recording

會議記錄

·Intelligibility

清晰度

·Noise Measurement

噪聲測量

5/64 Audio/Visual Camera In-Depth

5/64音視頻全景聲學(xué)相機

The AudioCamera’s spherical microphone architecture provides an omni-directional acoustic image of the environment. 

 聲學(xué)相機的球面麥克風(fēng)架構(gòu)提供了一個全方位的環(huán)境聲學(xué)圖像。

The microphone signals are conditioned using individualized pre-amp circuits and then converted to digital by a dedicated analog to digital converter. The digitized acoustic data are sampled at 44.1 kHz per channel and collected by an internal high performance Field Programmable Gate Array (FPGA) based processor where they are managed, formatted and converted into a single USB 3.0 data stream. FINDr software, operating on a standard PC with an internal NVIDIA GPU, accepts the USB data stream and performs the user selected functions in real-time. 

麥克風(fēng)信號使用個性化的前置放大器電路，然后由專用的模擬數(shù)字轉(zhuǎn)換器轉(zhuǎn)換為數(shù)字信號。數(shù)字化的聲學(xué)數(shù)據(jù)以每通道44.1 kHz采樣，并由一個內(nèi)部高性能現(xiàn)場可編程門陣列(FPGA)基于處理器收集，在那里他們被管理，格式化和轉(zhuǎn)換成一個單一的USB 3.0數(shù)據(jù)流。FINDr軟件在內(nèi)置NVIDIA GPU的標(biāo)準PC上運行，接受USB數(shù)據(jù)流并實時執(zhí)行用戶選擇的功能。

The auditory scene can be decomposed into its spherical harmonic components up to order 7. This allows for increased spatial isolation of acoustic sources in the environment. Additionally, the scene can be decomposed into filtered plane-waves, and can be beamformed into multiple real-time beams. A resolution of up to two degrees is possible for higher frequency beams. 

聽覺場景可以分解成高達7階的球面諧波分量。這使得聲源在環(huán)境中的空間隔離度提高。另外，可以將場景分解為濾波后的平面波，并可以將其波束形成多個實時波束。高頻波束的分辨率可以達到2度。

The video camera array generates an associated omni-directional panoramic visual scene that is synchronized with the live audio stream.

視頻攝像機陣列（全景聲學(xué)相機）生成了一個與實時音頻流同步的相關(guān)全方位即全景視覺場景。

 Five video cameras are integrated into the VisiSonics 5/64 Audio/Visual Camera to facilitate the panoramic scene capture. Each of the color video cameras has a resolution of 1328×1048 pixels. The captured video is synchronized with the audio data via an internal FPGA processor. The multi-camera image streams are collected via an internal USB 3.0 interface and sent to a laptop over a single USB 3.0 cable.

VisiSonics 5/64音頻/視頻攝像頭集成了五個攝像頭，以便于全景場景捕捉。每臺彩色攝像頭的分辨率為1328×1048像素。捕獲的視頻通過內(nèi)部FPGA處理器與音頻數(shù)據(jù)同步。多攝像頭圖像流通過內(nèi)部USB 3.0接口收集，并通過一根USB 3.0電纜傳輸?shù)焦P記本電腦。

 Included with the all Audio Cameras is the Frequency Identification and Noise Detector (FINDr) software.

所有的聲學(xué)相機里都包含頻率識別和噪聲探測器（FINDr）軟件。

 With FINDr, you have the ability to visualize and analyze your recorded data. The FINDr software gives you instant access to an integrated audio/video panorama, and breaks down the data for you in helpful graphs for both time and frequency domain analysis. 

使用FINDr，您可以可視化和分析記錄的數(shù)據(jù)。FINDr軟件使您能夠即時訪問集成的音頻/視頻全景圖，并將數(shù)據(jù)分解為有用的圖形，以便進行時域和頻域分析。

See our Software page for more information.