The correct understanding of the concept of "society" is an important prerequisite for the correct recognition and understanding of the relationship between individuals and the society in Marx thought, Marx's theory of socialism and even the whole historical materialism. Domestic scholars have conducted a series of theoretical exploration focusing on the concept of "society". Based on the assessment of traditional social view on this problem, Giddens tried to solve this problem and put forward the four-factor view. For this, from the economics-philosophy perspective, this paper points out that the concept of "society" is economic-production relations in essence; Giddens's so-called social space, ownership, system clustering and social identity are only external factors influencing the concept of "society". The differences in these two concepts of "society" stem from the difference of the methodology of viewing the "society". As for methodology, it neither confuses social provisions at different levels nor uses social provisions at specific levels to exclude or even replace social requirements at essentially abstract level. As for the theoretical and practical significance, the expurgation of the concept of "society" not only helps people to dialectically examine modern society and rationally critique capitalist society, but also is beneficial to thinking about future development direction of the society.