An approach will be presented how users can be supported to evaluate the credibility of online content through automatically created labels. People using digital media often come across false information, including misinformation, disinformation, and malinformation, that is spread over online platforms. Due to bounded rationality effects, such as limited time resources, limited information resources, or limited ability to evaluate information, people might believe and share false information. The concept d eveloped in the H.2020 project PROVENANCE aims at supporting users of online media to detect problematic content with the help of a tool that automatically provides various types of warning labels regarding several features of online information. Overall this approach tries to combat disinformation by integrating the technical and human perspective. A preliminary study has shown the positive effect in terms of increased performance of judging online content. A future study aims at measuring long-term effects of information literacy development by the regular use of this tool.