MFAE: Multimodal Feature Adaptive Enhancement for Fake News Video Detection

With the rapid global growth of short video platforms, the spread of fake news has become increasingly prevalent, creating an urgent demand for effective automated detection methods. Current approaches typically rely on feature extractors to gather information from multiple modalities and then generate predictions through classifiers. However, these methods often fail to fully utilize the complex information across all modalities and overlook the potential for video manipulation, limiting their overall performance. To tackle these issues, MFAE is proposed, a novel framework for Multimodal Feature Adaptive Enhancement for Fake News Video Detection. The framework starts by extracting semantic and emotional features from the news, which are the basis for generating coarse multimodal representations. These representations are further refined through Adaptive Enhancement, a module specifically designed to strengthen the visual and audio modalities. Subsequently, spatial and temporal features are extracted separately, with temporal features undergoing additional refinement via a Temporal Enhancement module. The final result is obtained by feeding the individually enhanced features into the multimodal feature integration module for interaction Comprehensive experiments on two benchmark datasets highlight the exceptional performance of MFAE in detecting fake news on short video platforms. Specifically, the method achieves accuracy improvements of 2.21% and 4.35% on FakeSV and FakeTT, respectively.