Convergent evidence has shown that brain functions can manifest on brain networks on different scales and brain malfunctions caused with most psychiatric disorders are faulty brain networks. In order to understand how the brain works and the pathophysiological mechanism of psychiatric disorders, it is necessary to integrate the multi-level network features obtained with various functional and anatomical brain imaging technologies on different scales. We have proposed a new concept of “brainnetome” to represent such integration framework. We define the essential components of brainnetome as network topological structure (connectome), performance, dynamics, manifestation of functions and malfunctions of brain on different scales, genetic basis of brain networks, and the simulating and modeling brain networks on supercomputing facilities. The brainnetome consortium here is based on our current project (973 program) awarded by the Ministry of Science and Technology of China in 2010. This project conducts studies of brainnetome for four different diseases with focal lesion (stroke and glioma) and diffusion lesions (schizophrenia and AD) on the macroscale with multimodal imaging and electrophysiological technologies. We are keen on expanding this consortium to include scientists from other institutions who have been working on different scales, especially the scientists who have involved in the Human Connectome Project and similar projects. It envisions that brainnetome will become an emerging co-frontier of brain imaging, information technology, neurology and psychiatry. Some long-standing issues in neuropsychiatry may be solved by combining brainnetome with genome. More and more supports for Brainnetome Project have been obtaining from Chinese government and outside China.