In
1935, under the name Kang Sheng, he returned to
Mao Zedong's base at
Yan'an (Yenan). In
Moscow, Kang had already realized that
Wang Ming was falling out of
Moscow's favor, and
Zhang Guotao was originally selected by the
Comintern to replace Wang. Kang Sheng defected immediately from Wang's camp, but he was very clever politically and instead of directly siding with
Zhang Guotao to fight both
Wang Ming and
Mao Zedong, he allied himself with Mao to destroy Wang's faction within the communist party, seeing Wang as the greatest enemy at the time. After Kang Sheng's death, the Chinese communist regime accused him of planning to use Mao's power and influence to defeat Wang's faction first and once Mao's camp was weakened in the struggle against Wang's camp, Kang Sheng would then show his true colors by supporting Zhang Guotao. Whatever the validity of this accusation, Kang Sheng did not have the opportunity to prove this accusation bestowed on him after his death: although Wang Ming's faction was successfully purged, Zhang Guotao's power and influence diminished to nearly zero as well: around a year later, Zhang's remaining force, which was the largest among the Chinese Red Army, was completely annihilated by the
Ma clique of the
nationalist warlords in 1936. Kang Sheng immediately joined Mao's camp; since he appeared only involved in fighting Wang Ming's faction but not openly provide direct support Zhang Guotao's camp, Mao reward Kang as the head of the so-called Social Affairs Department, the Party's chief security service, which he headed until
1949.
In order to completely eliminate
Wang Ming's and
Zhang Guotao's power bases and allies in CPC, Mao and Kang launched the "
Zheng Feng" in
1942. Although it was ostensibly a campaign only to ensure political conformity with
Mao Zedong Thought, mainly through ideological criticism and self-criticism, it evolved into a vicious campaign of physical and psychological persecution of real or imagined dissidents. At one point the number of victims was so large that fierce resistance had accumulated against Mao's authority, threatening his position of supremacy within the movement. Kang was eventually compelled to shoulder the blame for his crimes and to make apologies for his excesses in public, after which he kept a low profile in the years to follow. On the other hand, after the
Stalinist campaigns executed and overseen by Kang, the KMT discovered that it was quite difficult to infiltrate the CPC’s camp and to obtain valuable intelligence about the CPC as it had done effectively in the 1930s when the CPC operated in major cities such as
Shanghai. Kang employed "red terror" tactics in
Yan'an, turning it into a closed empire, and greatly improved the efficiency with which Mao’s orders were carried out, which contributed to the CPC’s victory, as compared with the KMT’s inefficient methods of policy execution.
During the 1946-49
Chinese Civil War, Kang was demoted to CPC chief in
Shandong Province and appointed only as Second Vice General Secretary of the
East China Bureau of the CPC, in which he carried out the land reform movement with a zeal that led him to encourage the murder of many landlords in
Shanxi and
Shandong Provinces.
At
Yan'an, Kang became a close friend of
Jiang Qing, who may have been Kang's maid during his youth in
Shandong, and who became a second-rate young actress in
Shanghai and a newly converted Communist. He introduced her to
Mao Zedong, who later married her. Before Mao and Jiang's marriage, Kang abused his power of censorship to conceal Jiang's arrest by and confession to the
Kuomintang in
Shanghai, which might have impeded the marriage and altered the course of China's modern history. This favor, along with his role in the security apparatus, made Kang one of the most intimate figures in the Party of Mao and served to save Kang from time to time.