When we are involved in the “science” and “spirits” of the “May 4th” period, on the one hand, the enlightenment of the people to the blind state of feudal superstition; on the other hand, the attempt to build a new culture, the two are mutually exclusive, it also affects each other. Until the “May 4th” period, the so-called “science” was not only a new knowledge system and method, but actually more marked the critical spirit played by an intellectual, and even determined their outlook on life. The use of “science” to overthrow spirits is undoubtedly one of the main manifestations of the “May 4th” enlightenment, but from another perspective, the slogans such as “overthrow spirits” in this period are not limited to criticizing old cultures. The old idols are defeated, and they are “the mind of the enlightenment” and “the thought of liberating people”. From the perspective of the history of human development, it has profound historical and cultural significance. This paper makes an attempt to discuss about the Ideological approach to atheist in the period of the May 4th Movement, with Chen Duxiu陳獨秀 and Hu Shi胡適 as the breakthrough point, trying to discuss about of “science” and “spirits” in the early period of the May 4th Movement. Both Chen Duxiu and Hu Shi represent the two flags set up by the “May 4th” intellectuals. At that time, they actively participated in the “spirits” critique, advocated the abolition of feudal superstitions, had great beliefs and beliefs in science, and advocated “scientific” no ghosts. According to this, this thesis puts it into the ideological discourse, tries to touch the thought connotation behind Chen Duxiu & Hu Shi’s scientific view and its implications. As for Chen Duxiu's scientific view, it is based on the banner of the “May 4th” anti-feudal ideology revolution. Chen believes that “science” is not only an independent disciplinary system, but also an ideological weapon, not only in the specific conditions of the “May 4th”. What has been formed is also produced in the current situation of the political and social contradictions of modern China and the national crisis and cultural imbalances. What needs to be paid attention to is that under the premise and conditions of “ethical consciousness”, Chen Duxiu pointed to the extremely “false” and “distorted” concept of spirits and its that existed in the minds and hearts of the people at that time, thus treating the “spirits” belief as poisoning people's souls and “anti-ethics” thoughts; like Chen Duxiu, Hu Shi's scientific view is also on the banner of the “May 4th” anti-feudal revolution, but Hu Shi’s scientific view is derived from his family influence and personal experience in his childhood, and the influence of Western learning in his youth. These internal and external factors make Hu Shi more seeking science and pursuing the truth, thus vividly reflecting his unique “ideology and personality” and “atheism” thinking. Hu Shi not only adheres to “freedom of thought”, but also actively accepts the “scientific method” of Western learning. The two self-contained systems form an “ideology argument” and become the most important ideological resource in Hu Shi’s academic research and ideological practice. Under the two flags of “Democracy” and “Science” during the May Fourth Movement, the two have had far-reaching implications for the future of China. The “May 4th” intellectuals have made their own inner voices, and so far can give us a new thinking, there is still room for further understanding and research. This just shows the long-lasting charm of the “May 4th” discourse, and it also shows why we need to pay attention to the “May 4th” discourse.