Jump to content

KNIME

From Wikipedia, the free encyclopedia

KNIME
Developer(s)KNIME
Initial release2006; 19 years ago (2006)
Stable release
5.4 / 6 December 2024; 5 months ago (2024-12-06)[1]
Repository
Written inJava
Operating systemLinux, macOS, Windows
Available inEnglish
Typeguided analytics, enterprise reporting, business intelligence, data mining, deep learning, data analysis, text mining, big data
LicenseGNU General Public License
Websitewww.knime.com

KNIME (/naɪm/ ⓘ), the Konstanz Information Miner,[2] is a data analytics, reporting and integrating platform. KNIME integrates various components for machine learning and data mining through its modular data pipelining "Building Blocks of Analytics" concept. A graphical user interface and use of Java Database Connectivity (JDBC) allows assembly of nodes blending different data sources, including preprocessing (extract, transform, load (ETL)), for modeling, data analysis and visualization with minimal, or no, programming.[citation needed] It is free and open-source software released under a GNU General Public License.

Since 2006, KNIME has been used in pharmaceutical research,[3] and in other areas including customer relationship management (CRM) and data analysis, business intelligence, text mining and financial data analysis.[4] Recently, attempts were made to use KNIME as robotic process automation (RPA) tool.[5][when?]

KNIME's headquarters are based in Zurich, with other offices in Konstanz, Berlin, and Austin (USA).[citation needed]

History

[edit]

Development of KNIME began in January 2004, with a team of software engineers at the University of Konstanz, as an open-source platform. The original team, headed by Michael Berthold, came from a Silicon Valley pharmaceutical industry software company. The initial goal was to create a modular, highly scalable and open data processing platform that allows easy integration of different data loading, processing, transforming, analyzing, and visual exploring modules, without focus on any one application area. The platform was intended for collaborating, research, and for integrating various other data analysis projects.[6]

In 2006, the first version of KNIME was released. Several pharmaceutical companies began using KNIME, and several life science software vendors began integrating their tools into the platform.[7][8][9][10][11] Later that year, after an article in the German magazine c't,[12] users from a number of other areas[13][14] joined ship. As of 2012, KNIME is in use by over 15,000 actual users (i.e. not counting downloads, but users regularly retrieving updates) in the life sciences and at banks, publishers, car manufacturer, telcos, consulting firms, and various other industries, and a large number of research groups, worldwide.[citation needed][needs update] Latest updates to KNIME Server and KNIME Big Data Extensions, provide support for Apache Spark 2.3, Parquet and HDFS-type storage.[citation needed]

For the sixth year in a row, KNIME has been placed as a leader for data science and machine learning platforms in Gartner's Magic Quadrant.[citation needed][year needed]

Design philosophy, features

[edit]

These are the design principles and features that KNIME software follows:[15]

  • Visual, Interactive Framework: KNIME Software prioritizes a user-friendly and intuitive approach to data analysis. This is achieved through a visual and interactive framework where data flows can be combined using a drag-and-drop interface. Users can develop customized and interactive applications by creating simple to advanced and highly-automated data pipelines. These may include, for example, access to databases, machine learning libraries, logic for workflow control (e.g., loops, switches, etc.), abstraction (e.g., interactive widgets), invocation, dynamic data apps, integrated deployment, or error handling.
  • Modularity: processing units and data containers should remain independent of each other. This design choice enables easy distribution of computation and allows for the independent development of different algorithms. Data types within KNIME are encapsulated, meaning no types are predefined. This design choice facilitates adding new data types, and integrating them with extant types, while including type-specific renderers and comparators. This principle also enables inspecting results at the end of each single data operation.
  • Extensibility: KNIME Software is designed to be extensible. Adding new processing nodes or views is made simple through a plug-in mechanism. This mechanism ensures that users can distribute their custom functionalities without the need for complicated install or uninstall procedures.
  • Interleaving No-Code with Code: the platform supports integrating both visual programming (no-code) and script-based programming (e.g., Python, R, JavaScript) approaches to data analysis. This design principle is termed low-code.
  • Automation and Scalability: for example, the use of parameterization via flow variables, or the encapsulation of workflow segments in components contribute to reduce manual work and errors in analyses. Further, the scheduling of workflow execution (available in KNIME Business Hub and KNIME Community Hub for Teams) reduces dependency on human resources. In terms of scalability, a few examples include the ability to handle large datasets (millions of rows), execute multiple processes simultaneously out of the box and reuse workflow segments.
  • Full Usability: due to the open source nature, KNIME Analytics Platform provides free full usability with no limited trial periods.

Internals

[edit]

KNIME allows users to visually create data flows (or pipelines), selectively execute some or all analysis steps, and later inspect the results, models, using interactive widgets and views. KNIME is written in Java and based on Eclipse. It makes use of an extension mechanism to add plug-ins providing added functions. The core version includes hundreds of modules for data integration (file input/output (I/O), database nodes supporting all common database management systems through JDBC or native connectors: SQLite, MS-Access, SQL Server, MySQL, Oracle, PostgreSQL, Vertica and H2), data transformation (filter, converter, splitter, combiner, joiner), and the commonly used methods of statistics, data mining, analysis and text analytics. Visualization is supported with the Report Designer extension. KNIME workflows can be used as data sets to create report templates that can be exported to document formats such as doc, ppt, xls, pdf and others. Other KNIME abilities are:

  • KNIMEs core-architecture allows processing of large data volumes that are only limited by the available hard disk space (not limited to the available RAM). E.g., KNIME allows analyzing 300 million customer addresses, 20 million cell images, and 10 million molecular structures.
  • Added plug-ins allow integrating methods for text mining, image mining, time series analysis, and networking.
  • KNIME integrates various other open-source projects, e.g., machine learning algorithms from Weka, H2O.ai, Keras, Spark, the R project and LIBSVM; plotly, JFreeChart, ImageJ, and the Chemistry Development Kit.[16]

KNIME is implemented in Java, allows for wrappers calling other code, in addition to providing nodes that allow it to run Java, Python, R, Ruby and other code fragments.[citation needed]

License

[edit]

In 2024, KNIME version 5.3 is released under the same GPLv3 license as previous versions.[17] As of version 2.1, KNIME is released under the GPLv3 license, with an exception that allows others to use the well-defined node application programming interface (API) to add proprietary extensions.[18][needs update] This allows commercial software vendors to add wrappers calling their tools from KNIME.

Courses

[edit]

KNIME allows the performance of data analysis without programming skills. Several free, online courses are provided.[19]

See also

[edit]
  • Weka – machine-learning algorithms that can be integrated in KNIME
  • ELKI – data mining framework with many clustering algorithms
  • Keras – neural network library
  • Orange – an open-source data visualization, machine learning and data mining toolkit with a similar visual programming front-end
  • List of free and open-source software packages

References

[edit]
  1. ^ "What's New in KNIME Analytics Platform 5.4". KNIME.com. Retrieved 7 December 2024.
  2. ^ Berthold, Michael R.; Cebron, Nicolas; Dill, Fabian; Gabriel, Thomas R.; Kötter, Tobias; Meinl, Thorsten; Ohl, Peter; Thiel, Kilian; Wiswedel, Bernd (16 November 2009). "KNIME - the Konstanz information miner" (PDF). ACM SIGKDD Explorations Newsletter. 11 (1): 26. doi:10.1145/1656274.1656280. S2CID 408188.
  3. ^ Tiwari, Abhishek; Sekhar, Arvind K.T. (October 2007). "Workflow based framework for life science informatics". Computational Biology and Chemistry. 31 (5–6): 305–319. doi:10.1016/j.compbiolchem.2007.08.009. PMID 17931570.
  4. ^ Chasco, Coro; Taques, Fernando H.; Taques, Flávio H. (January 2025). "Integrating big data with KNIME as an alternative without programming code: an application to the PATSTAT patent database". Journal of Geographical Systems. 27 (1): 31–61. Bibcode:2025JGS....27...31T. doi:10.1007/s10109-024-00445-0.
  5. ^ "KNIME Analytics Platform Bot". Archived from the original on 3 June 2021. Retrieved 12 April 2021.,
  6. ^ "Open for Innovation". KNIME.com. Archived from the original on 10 March 2020. Retrieved 24 February 2020.
  7. ^ "Tripos". Tripos, Inc. Archived from the original on 17 July 2011.
  8. ^ "KNIME Extensions: Modular, highly configurable framework for easy workflow automation and data analysis". Schrödinger, Inc. 2005–2025. Archived from the original on 25 September 2009. Retrieved 22 May 2025.
  9. ^ ChemAxon Archived 2011-07-17 at the Wayback Machine
  10. ^ "NovaMechanics Ltd". Archived from the original on 18 April 2023. Retrieved 14 November 2017.
  11. ^ "Treweren Consultants". Archived from the original on 24 April 2017. Retrieved 7 December 2010.
  12. ^ Datenbank-Mosaik Data Mining oder die Kunst, sich aus Millionen Datensätzen ein Bild zu machen, c't 20/2006, S. 164ff, Heise Verlag.
  13. ^ "Forum auf der KNIME Webseite". Archived from the original on 26 April 2017. Retrieved 7 December 2010.
  14. ^ "Pervasive". Archived from the original on 29 August 2010. Retrieved 7 December 2010.
  15. ^ Berthold, Michael R.; Cebron, Nicolas; Dill, Fabian T.; Gabriel, homas R.; Kötter, Tobias; Meinl, Thorsten; Ohl, Peter; Thiel, Kilian; Wiswedel, Bernd (16 November 2009). "KNIME-the Konstanz information miner: version 2.0 and beyond". AcM SIGKDD Explorations Newsletter. 11 (1): 26–31. doi:10.1145/1656274.1656280.
  16. ^ Beisken, S.; Meinl, T.; Wiswedel, B.; De Figueiredo, L. F.; Berthold, M.; Steinbeck, C. (2013). "KNIME-CDK: Workflow-driven Cheminformatics". BMC Bioinformatics. 14: 257. doi:10.1186/1471-2105-14-257. PMC 3765822. PMID 24103053.
  17. ^ "KNIME 5.3 License Terms and Conditions". 3 August 2024. Archived from the original on 3 August 2024. Retrieved 3 August 2024.
  18. ^ KNIME 2.1.0 released Archived 2010-04-17 at the Wayback Machine
  19. ^ "KNIME Learning Center". KNIME. Archived from the original on 23 November 2024. Retrieved 4 December 2024.
[edit]
  • Official website
  • KNIME on GitHub
  • KNIME Hub - Official community platform to search and find nodes, components, workflows and collaborate on new solutions
  • Nodepit - KNIME node collection supporting versioning and node installation
Retrieved from "https://en.wikipedia.org/w/index.php?title=KNIME&oldid=1291884943"