literature_pre = await FileAttachment("data/Literature.csv").csv()
benchmark_datasets_pre = await FileAttachment("data/Benchmark_datasets.csv").csv()
literature = literature_pre.filter(d => !d.Name.includes("EXCLUDE") && !d.Name == "")
benchmark_datasets = benchmark_datasets_pre.filter(l => l.Name != "" && l.Name != "Debates")
paper_sources_pre = await FileAttachment("data/Paper Sources.csv").csv()
paper_source = paper_sources_pre.filter(l => l.Name != "")
GLADOS: Graph Layout Algorithm benchmark Datasets for Open Science
Under Review
This paper is under review on the experimental track of the Journal of Visualization and Interaction. See the reviewing process.
1 Introduction
Benchmarking is a crucial aspect of computer science, as it allows researchers, developers, and engineers to compare the performance of various systems, algorithms, or hardware. A benchmark is a standardized test or set of tests used to measure and compare the performance of hardware, software, or systems under specific conditions. Benchmarking aims to provide objective and consistent metrics that allow for fair comparisons and informed decision-making. Benchmarks are widely used in various fields, including computer hardware evaluation, software optimization, and system performance analysis. In all these fields, benchmarking provides a standardized and objective way to compare and assess the performance of different systems, algorithms, or software implementations. It aids in making informed decisions about which solution best suits a specific use case or requirement.
The same is true for graph drawing, particularly for studying the performance and results of graph layout algorithms (Di Bartolomeo et al. 2024). Benchmark datasets can provide a standardized set of graphs with known properties and characteristics. These graphs can vary in size, density, connectivity, and structure. Having reference collections of benchmark graphs is a huge positive for these evaluations: indeed, if algorithms are tested on the same easy-to-find datasets, it becomes easier to compare them and benefits the reproducibility of the experiment. Researchers can objectively compare their performance or the quality of their results by applying various graph layout algorithms to the same benchmark dataset.
In our own work, we have faced challenges in determining which benchmark datasets to use for evaluating the layout algorithms we developed. This led us to build a collection of benchmark datasets used in previous graph layout algorithm papers and a Graph Benchmark Datasets website for perusing the collection. We collected 196 papers from Graph Drawing, IEEE venues, and Eurographics venues that include computational evaluations of graph layout algorithms. We then searched for the datasets used for the benchmarks. We collected the data we could find and had permission to archive and re-created datasets that were lost but had sufficient replication instructions. We classified graphs by their features and statistics. We also found text and images from papers using those graphs.
This paper aims to present this graph drawing benchmark sets resource to the Graph Drawing and visualization communities so that other authors may benefit from our archiving and organization efforts. We hope this resource will encourage the discoverability of these datasets and the ease of running benchmarks for graph layout algorithms. Moreover, as reliable access to datasets is fundamental for replicability, we aim to preserve these datasets in perpetuity. Beyond collecting available datasets and re-creating lost ones, we archived all our materials on OSF for long-term availability. This included saving each graph in multiple common file formats to avoid translation issues for individual authors. We believe our work will lead to more reproducible and replicable Graph Drawing research by providing a long-term and open archive of the data we use in our computational evaluations.
Specifically, we contribute:
- A systematic collection of the graphs commonly used in Graph Drawing research—along with a characterization of the graph features available in each dataset—which will help future researchers and practitioners identify appropriate benchmark datasets to use for their evaluations. The work we did also includes reconstructing lost datasets based on author descriptions, or scouting through citations or emailing authors to hopefully find these lost collections.
- A website for perusing this collection, available here.
- A long-term archive of our metadata and the collection to aid in reproducibility and replicability of evaluations.
Please see our materials statement above for our supplemental materials, including links to the website, code and data, OSF archive, and Notion database.
2 Motivation and Background
This work stems from the challenges we encountered in finding datasets tailored to test graph layout algorithms. When developing a graph layout algorithm which handles specific features (such as layers, or clusters), it is essential to have a benchmark dataset that reflects these features. While conducting our own evaluations, we found it difficult to find datasets that would incorporate features that we needed. This submission is part of an ongoing effort to keep a curated list of datasets.
Our work focuses on providing a graph benchmark collection that categorizes datasets by how they organize their graphs and emphasizes their features. We aim to facilitate researchers’ choice of benchmarks to reflect real use cases or allow comparisons to other algorithms in their respective fields. Although a number of graph repositories exist, their target and objectives are not always aligned with the needs of graph drawing researchers. While the scope of this work revolves around compiling graphs and networks used in the graph drawing literature, we highlight that other, adjacent fields have also created similar repositories tailored to different needs. For example, the Network Repository consists of a comprehensive collection of datasets that contain many attributes and are used for benchmarking in machine learning, data mining, and many other network applications (Rossi and Ahmed 2015). In biology, the KEGG Encyclopedia of Genes and Genomes contains network information relevant to biological pathways (Kanehisa Laboratories 2023). Some general-purpose collections used in network science are also relevant to our discussion. Among the most famous ones, the SuiteSparse Matrix Collection, the Stanford Network Analysis Project (SNAP), and the Pajek collection stand out since they propose large compilations of datasets that often come from diverse sources. The Open Graph Benchmark collection from W. Hu et al. (2020) is also worth mentioning, but it is made specifically for training machine learning models, which is not the focus of our work. Much simpler examples of similar collections can be found in curated lists of links on GitHub, often referred to as awesome lists, where a short comment usually accompanies every entry (for instance, here and here). The purpose and scope of such repositories is provided with more depth in Section 4.1.2.
Such lists can serve as great tools to find particular case studies, but they do not serve the same purpose as a uniform collection like Rome-Lib: a collection of graphs with similar features that can be used to test an algorithm on thousands of graphs with increasing nodes. Rome-Lib is hosted on the main website of the Graph Drawing website, as proof of its usefulness as a benchmark dataset, together with the AT&T graphs and the random DAGs. Another example is the Graph Partitioning Archive, also known as the Walshaw Collection, which compiles relevant graphs and partitioning algorithms from disparate sources in the relevant literature (Walshaw and Cross 2000). The uniformity of such collections allows scientists to easily run thousand of tests on similar graphs, allowing to test the scalability of an algorithm varying density, number of nodes and number of edges — as opposed to the previously mentioned collections, where the focus is on the diversity of the graphs. See Section 4.1.1 for more information on this topic.
We care particularly about the reproducibility of past and future research. A dataset that has been used in an evaluation and is now unaccessible greatly hinders the reproducibility of the evaluation, and in the worst case it makes it impossible to reproduce, and, as such, much less meaningful. Losing a dataset to link rot is an unfortunately common problem in the digital age, as URLs change, websites go down, and data is lost. One example of this is the Open Graph Archive from Bachmaier et al. (2012), which was a project to create a graph database that categorizes, analyses, and visualizes graphs uploaded from the community, a laudable effort now rendered unfortunately inaccessible. At the time of writing, the popular repository Konect is also unavailable and only accessible through the webarchive, although all the links to it in previous papers are now broken. Several other instances are discussed in Section 4.1.5.
We tried to mitigate the problem of lost datasets by still documenting what we could find about them. For every dataset that we found that is now lost or inaccessible, we documented every detail we could find about it in literature, including descriptions and pictures of the rendered graphs, so that we can conserve a hint of what the dataset contained. We also went through a process of reaching out to authors and looking into internal storages of research groups (those that were available to us) to find datasets that were not available online. In a couple of cases, this led to successfull outcomes: see Storylines (Movie Plots).
We store our collection on the Open Science Framework (OSF), which is the currently recommended solution in the VIS community for long-term archival of research data. As per OSF’s backup and preservation policy, storage and open access is guaranteed for the next 50 years.
In this context, it is also worth mentioning that in recent years there have been several initiatives aimed at encouraging care for replicability in research. The Graphics Replicability Stamp is one of these, meant to be an endorsement of the replicability of the results presented in a paper, which ensures the replicability of the results of a paper through an additional review process. Another similar intiative are the ACM badges, or the SIGMOD availability and reproducibility initiative, which goes one step further and publishes full reports commenting on how reproducible a paper is.
This work proposes an overarching taxonomy of datasets and collections based on their structure while also providing a higher emphasis on the features and usage within the literature of our field. Our collection is offered as a complement to the previously mentioned collections, as we intend to aid researchers in finding graphs in the context of layout algorithms and network visualization, with an accent on encouraging efforts towards replicability.
3 Collection process
The information we collected is a by-product of a larger systematic review we conducted related to graph layout algorithms, which included 196 papers The following figure shows the original data collection process (from (Di Bartolomeo et al. 2024)):
The core of our data collection was the last seven years of Graph Drawing proceedings (264 papers in total), filtering out papers without computational evaluations. We further expanded our graph layout algorithm papers collection by searching IEEE Xplore and Wiley digital libraries to include papers from TVCG and CGF. Then, we checked all the citations in the papers we collected from Graph Drawing, and added to our collection all the papers that were cited more than 4 times in the last 6 years of graph drawing — to make sure we included algorithm papers that were important, but not published at GD, on IEEE Xplore or on the Wiley digital library. For each paper, we collected which features were handled by the graph layout algorithm presented, and what dataset was used in the evaluation. When collecting features, we always prioritized the authors’ own wording and description of the features. The tagging of the papers was done by two people at the same time, over two different passes for sanity-checking purposes. Following this process, we tried to track down the datasets used in computational evaluations: (1) we first looked for official or linked supplemental material, (2) we next Googled the dataset or paper name, (3) finally, we emailed the authors. When in doubt about the artifact replication policy, we asked the owners or authors by email. In cases where it was explicitly mentioned that approval should be received before redistribution, we did not redistribute the datasets. However, if we received approval or did not receive an answer and found no explicit policy preventing redistirbution, we collected and stored the dataset to preserve it for future researchers. If any dataset owner or author discovers their own work in our collection and would like it removed, we kindly request that they contact us (see our authorship statement above), and we will promptly remove it. Furthermore, we want to emphasize that we do not assert any ownership rights over the datasets listed.
The chart below shows the distribution of papers across different venues:
The following one, instead, shows the distribution of collected papers’ publication date:
After collecting the datasets, we looked more in-depth into their contents, running analysis on a number of statistics associated with the graphs contained in them. Based on common metrics reported in Di Bartolomeo et al. (2024), we collect and plot statistics about the datasets: distribution of number of nodes, edges, mean degree and maximum degree. Additionally, we collected all the descriptions of the datasets we could find in the literature, which can contain relevant information about the origin of the dataset or its content, and we collected figures representing the content of the datasets taken from papers that use it, to give a visual representation and an immediate idea of the graphs contained in it.
3.1 Data Processing
Further complicating the replicability and reproducibility issues previously outlined is the problem of storing data in a consistent format. Datasets cited in different papers link to downloads for which the graph structure is very difficult to piece together—most commonly, paper authors write code to extract this structure for their specific needs, but this code is often tedious to recreate (if the authors went through the trouble of meticulously describing their process in the paper) or difficult and time-consuming to reappropriate (if it is contained in their supplemental materials, and they still exist on the web). In the worst case, both of these options are lost over time and the original graphs used become impossible to recreate. Hence, storing and organizing this data in multiple accessible formats is of great importance for the replicablility of these works and for further research in the field.
For each dataset included in our repository, we have performed the work required to extract the graph structure per the original author’s specifications, or linked to an established network repository such as SNAP or SuiteSparse Matrix Collection that hosts the files. Writing custom code for this purpose was necessary for 32 of the 49 included datasets. Our code is available at github.com/VisDunneRight/benchmark_sets_analysis_data/, which also has the original data we downloaded when the files were small enough to be uploaded to GitHub.
We chose to convert and store several of the datasets in a uniform JSON representation because it is a highly versatile and easily accessible format that allowed us to easily represent a large and varied amount of characteristics that different graphs might have—such as nodes having associated timestamps, labels, or belonging to a clusters, and edges having weights. The style of JSON representation we used for graphs is based on several d3 examples, such as the one used in the d3 documentation, and is the same format used by the JSON read/write functions in NetworkX. For ease and accessibility, we have also converted and made available all graphs in three additional commonly-used formats: GraphML, GEXF, and GML.
4 Datasets in use
The following chart shows how many times we found a dataset being used in the papers we collected. It excludes custom edits to the datasets, which are discussed later in this document.
In the data we collected, the most used dataset is Rome-Lib, followed by assorted collaboration networks (which in many cases refers to datasets of academic collaborations such as dblp or vispubdata). The third most used dataset is from C.Walshaw - it is important to note that the Walshaw dataset is available as part of other collections - for instance, its graphs are found in SNAP. However, during the collection process, we preferred giving precedence to how the authors reported their own information. Thus, if the authors claimed the data was from the Walshaw collection, we reported it as such.
For each of the datasets collected as part of our process, we conducted a brief analysis of their contents. Where possible, the analysis includes information about the number of nodes per graph, the source of the dataset, which papers have used the dataset and what graph features they took into account.
In the following sections, the reader will find details about the classifications and datasets in detail. Each dataset gets a dedicated, collapsible section, that contains the following information:
- A brief summary description of the dataset, the reasons for its popularity, and notes about how it was created or collected.
- Metadata containing:
- The original source of the dataset.
- Links to download the dataset in different formats, provided from our OSF repository.
- The size of the dataset.
- The original paper where the dataset was first introduced.
- A list of papers that have used the dataset, together with what features their graph layout algorithm handles.
- Charts illustrating node and edge count distribution through the dataset, mean and maximum distribution.
- Descriptions of the datasets lifted directly from the literature, which can help shine light on the content and properties of the dataset, how it was used in previous literature, or how it originated.
- Figures collected from the literature, such as visualizations of the graphs, or other relevant information. The visualizations can help a reader looking for a specific type of graph to quickly identify if the dataset is relevant to their research.
4.1 Classification of the Datasets
The datasets we collected are divided in different categories: the categorization we used is the same as the one used in Di Bartolomeo et al. (2024). The following is a brief explanation of the categories used, which are explained in deeper detail in each one of the corresponding chapters.
- Uniform Benchmark (Section 4.1.1): Datasets that are standalone widely used collections of graphs featuring uniform characteristics - usually simple, generic graphs, often used in evaluations that run over thousands of graphs to report average completion times, or other experiments where the reported metrics are usually aggregated.
- Established Network Repository (Section 4.1.2): A collection of individual, or groups of graphs, part of a larger repository. These datasets are often used in evaluations that require a diverse set of graphs, or when the evaluation is focused on a specific type of graph. These collections usually also report on graphs with their own statistics or visualizations, providing a summary of the dataset. This category also includes Subsets (Section 4.1.2.10).
- Single Graphs (Section 4.1.3): The data used is comprised of one individual graph, which often contains special characteristics making it particularly relevant for the evaluation at hand.
- Aggregate Collections (Section 4.1.4): Collections of graphs focusing on one specific context (such as forum posts, or airline routes) due to the given context having a special set of features that is relevant for a graph layout algorithm.
The type of collection informs various aspects of an evaluation, such as which results are relevant to report. For this discussion, we refer to Di Bartolomeo et al. (2024), where the authors link the type of collection in the context of graph layout evaluations.
The following visualization shows the amount of datasets we collected per category:
Unfortunately, some of the datasets used in layout algorithm evaluations are not accessible anymore. Where possible, we still collected and reported all the information contained in the papers about the datasets, so that we can conserve an idea of what they contained. This phenomenon, as long as the information we could collect, is discussed in Lost and Unavailable Datasets (Section 4.1.5).
Finally, we include a discussion on Custom-made Datasets (Section 4.1.6), synthetically generated datasets for the purpose of an experiment.
Each dataset also contains a number of graph features specific to the graphs contained in it. Authors might want to use a dataset that contains a specific feature, such as a graph with a high number of nodes, or a graph with a specific structure. The following interactive filtering systems allows for filtering of datasets (and papers) based on the features they contain.
Tag-filtered Navigation
The following interactive filtering system is an initial overview over the contents of the paper, and can be used to navigate and identify datasets and papers easily. The left column contains all the properties used to tag graphs in the datasets (additional information about the nature of these tags can be found in Section 3 and Section 3.1). Each tag has an associated checkbox: selecting a tag (or more than one) will filter the datasets and papers to only show those that contain the selected tags. The middle column contains the datasets, and the right column contains the papers. Clicking on a dataset or paper will scroll the page to the corresponding section in the paper. The datasets and papers are sorted alphabetically by name and citation name, respectively. The tags, datasets, and papers are generated from the data in the repository, and are updated automatically when the data changes.
Tags
Datsets
Papers
Uniform Benchmark datasets
Uniform Benchmark datasets are standalone widely used collections of graphs featuring uniform characteristics—usually simple, generic graphs, often used in evaluations that run over thousands of graphs to report average completion times, or other experiments where the reported metrics are usually aggregated.
Differently from the collections presented later in this section, an experiment that uses an Uniform Benchmark dataset aims to provide a general overview of the performance of a graph layout algorithm by testing on a large amount of graphs varying in size and density, rather than focusing on a specific type of graph.
The first of these collapsible sections is shown already expanded, to give an example of the content that can be found in each of them. The content is generated dynamically based on the data we collected.
The following collections, together with Rome-Lib, can be easily accessed from the homepage of the Graph Drawing Conference website, and are therefore well known and widely used.
A very common problem in graph drawing is approximating or computing the exact crossing number of a graph. The datasets listed below are particularly useful when researchers are particularly useful for this task, as they contain graphs with Known crossing numbers, so that other algorithms’ results can be tested against them.
In some cases, authors of algorithms that deal with particular graph types might prefer to focus on collections with specific attributes, that might be attributes of the nodes, the edges or the entire graph. This is the case of Storylines (Movie_Plots) and Militarized Interstate_Disputes (MID) for Temporal event sequences and World Maps for Geographicaldata:
The collections presented here are particularly varied in features:
Otherwise, one might decide to focus on a particular domain:
And finally, a collection of graph problems:
Additional interesting graphs can be found in the Graph Drawing Contest website.
Established Network Repositories
A popular choice is to use datasets from Established Network Repositories. These are ample collections, often organized in dedicated websites which also offer a few stats about the contained graphs. These collections are particularly useful when trying to locate a graph with a specific structure or property.
Because their hosts are already dedicated to the maintaining and reporting of information on these collections, we do not include here any storage of the data (which would be redundant) or report statistics on them. Rather, our analysis here is focused on highlighting their properties, origins, and ways in which they have been used.
One more of such collections is Konect. At the time of writing, though, the website for Konect has been down for a while. Both the data and the website are still accessible through web archive—thus we do not consider this a lost collection.
Subsets of other collections
Some of the datasets mentioned in the papers have, after a certain time, been integrated into other, larger collections. This is a phenomenon that can happen through the years, through the redistribution and through the merging of different sources: the Walshaw dataset, for instance, was and still is distributed and cited as its own standalone dataset, but its graphs can be now found as part of many other larger collections. In order to keep precise records about the data, we kept these instances separated, in order to link papers to the individual dataset they used if they explicitly mention using one of these smaller collections. We classified these datasets as Subsets.
Single Graphs
A number of papers used individual, Single Graphs for their experiments instead of a collection. These graphs have become popular because of their properties as individual graphs - see, for example, the Enron dataset below, a huge individual graph that has a large variance in node degree distribution. Many of these graphs are also available in other repositories - their locations are noted wherever known.
Aggregate Collections
Many papers use graphs from specific domains that contain particular characteristics, such as geographical coordinates often found in airline data. Instead of collecting each of these individual, contextual datasets, we aggregated them into subcategories called Aggregate collections. These collections group together datasets from the same real-life context, which may have multiple sources. Real-life contexts are distinguishable by specific properties or requirements found in graphs from those sources; for instance, collaboration networks can be represented as hypergraphs, while air traffic routes have nodes (airports) with fixed spatial coordinates and numerous edges connecting the nodes, making them suitable for edge bundling algorithms. Individual information about each aggregate collection can be found in the papers that contain them.
Lost and unavailable datasets
Unfortunately, some of the datasets that were used in the papers in our corpus are lost, or not available anymore. A dataset that is not anymore accessible renders all the papers using it unfortunately not reproducible. Most of the instances we found became lost because of lack of maintenance of the original storage locations: websites, servers, or repositories. This is, unfortunately, a significant issue in science, which is now hopefully gaining more and more attention.
“Loss” of a dataset does not exclusively mean that the entire, original dataset became lost, but also that a paper using a dataset with particular edits—such as interpreting a debate as a graph between the participants—has not documented well enough their process and did not link to the edited dataset. This makes it impossible to reproduce the results of the paper, and is further discussed in Section 4.1.6.
While we did go through the effort, for each one of them, to recover them and store them on OSF, we could not find anywhere the following list of datasets:
This last one is not available as an individual download, but still navigable on the internet and could potentially be crawled:
Custom-made Datasets
In the data we collected, we also found several instances of custom-made datasets. We consider custom-made datasets either edits to pre-existing datasets, where the authors found it necessary to either split or modify the dataset in a particular way, or datasets completely made up from scratch using random generators or custom-made code. This can happen in cases where the authors of a paper needed a dataset containing particular characteristics which was not easy to find in the wild, so a new dataset was crafted.
For instance, consider the case where the authors of a paper develop an algorithm that works on hypergraphs. They want to test that the algorithm works, and test its performance on hypergraphs of various sizes, but datasets containing hypergraphs are difficult to find. For this reason, the authors craft one dataset synthetically, or take a pre-existing dataset and edit it so that it now contains hyperedges.
We split custom-made datasets in three categories, with their occurrences in the corpus of papers illustrated below:
Replicable datasets indicate cases where the authors have given enough information so that the experiment can be replicated exactly as it was run by the authors of a paper, or closely enough that the results obtained reflect the published ones very closely. This includes cases where either the authors published the entire dataset they used, they published the code they used to generate the dataset, or include an exact description of the steps they took to generate it.
Reproducible datasets are cases where the authors described the steps they took to generate and/or edit their datasets, but not in-depth enough so that the exact same graphs can be reproduced, and did not redistribute it. Results can still be reproduces somewhat closely if the authors took care to report enough information about their graphs.
For non-replicable datasets, we indicate cases where the authors did not distribute their datasets and did not include enough information in the paper so that their results could be replicated.
This information is closely tied to the distribution of supplemental material in papers, that is shown in the chart below:
This discussion is part of a larger discourse on research replicability, that is gaining traction in the scientific community. The ACM, for instance, has a policy on artifact review and badging, where authors are encouraged to submit their artifacts for review, and if they pass, they receive a badge that indicates the artifact is available for review. This is a step towards making research more replicable and reproducible, and we hope that our work will contribute to this effort.
See, e.g., ACM’s definitions at https://www.acm.org/publications/policies/artifact-review-and-badging-current.
4.2 Random generation
We discussed above that in a few cases, authors have generated their own datasets to test their algorithms. We call these generated datasets synthetic or custom, as opposed to datasets found in the wild. Generating a synthetic dataset can be essential for several reasons, particularly in the context of algorithm development and validation:
- Privacy and Publication Constraints: Imagine you’ve created an innovative algorithm using a dataset that, due to privacy concerns, cannot be shared publicly. To validate and share your work without compromising data confidentiality, creating a synthetic dataset that mirrors the essential features of the original data allows you to showcase your algorithm’s effectiveness while adhering to privacy restrictions.
- Benchmarking and Comparative Analysis: Suppose you have access to a single dataset that can be shared and wish to prove your algorithm’s robustness across various scenarios. Generating synthetic datasets with comparable characteristics provides a controlled environment to conduct benchmark studies. This approach enables scientists to demonstrate that your algorithm performs consistently well across datasets with analogous features, thereby reinforcing its applicability and reliability.
- Addressing Data Availability Issues: In certain situations, you might design an algorithm to process graphs with specific attributes only to discover the absence of publicly available datasets showcasing these features. Synthetic datasets become invaluable here, allowing you to create tailored data that incorporates the necessary characteristics. This approach not only facilitates the testing of your algorithm in a relevant context but also helps in illustrating its potential in hypothetical yet plausible scenarios.
We use the word synthetic too in cases where the dataset has been altered, sliced, or other modifications have been applied to it.
The following is a practical example of a case where you would need to edit a network:
Imagine you are building a visualization to deal with the entirety of the Enron Corpus dataset , which has hundreds of thousands of nodes and edges. Because of its size, you decide to slice up the large dataset in many smaller files, so you can run tests. This particular dataset, in addition to being a challenging problem because of its size, also has an interesting distribution of connection densities: some nodes are extremely well connected, while others are much less connected. Indeed, the dataset is comprised of a collection of emails sent by Enron executives - between themselves or between other employees of the company. Because of how the dataset is constructed - where only the emails from the executives are taken into account - it has a distinctive skew in the connectedness of the data: 158 nodes are extremely well connected, while the rest of the nodes are much less connected. Because of this, there’s uncountable mistakes that can be done through slicing this graph: for instance, slicing it so that the subset includes a less dense section of the entire graph will fail to provide a representative section.
While the creation of a synthetic dataset is a perfectly viable way to produce a benchmark set, in addition to replicability criteria (as discussed above), we also have to pay particular attention to a number of statistics related to the structure of graphs — both when generating new datasets, and when slicing up existing datasets to reduce their size, or to create more graphs from a single, larger graph.
The list of features to take into account to claim that a synthetic graph is comparable to another one would be long, and perhaps out of the scope of this publication. These are just a few examples of what could be relevant:
- Size (nodes, edges): The total number of nodes and edges in the graph, indicating its overall scale.
- Diameter: The longest shortest path between any two nodes, showing the graph’s maximum extent.
- Density: The ratio of existing edges to possible edges, reflecting how closely knit the graph is.
- Motifs: Recurring, significant subgraphs; identify which motifs occur more or less frequently than expected.
- Connectedness: Evaluates both the number and sizes of graph components, along with detailed analysis per component.
- Centrality Measures (betweenness, closeness, degree): Quantify the importance of nodes based on their position and connections within the graph.
- Special Cases:
- Layers: Characteristics like number of layers, nodes per layer, and inter-layer connections.
- Disjoint Groups: The count and size distribution of separate clusters, plus an analysis of each group’s properties.
- Overlapping Sets: Number and size distribution of intersecting groups, along with detailed features.
- Additional Node/Edge Data: Information such as timestamps, attributes, or weights that add context to nodes/edges.
- Dynamic: Describes changes in the graph over time, including the nature and frequency of node/edge modifications.
The generation of random graphs that accurately mimic specific features presents a complex challenge, that has been explored abundantly in the past, but has found no universal solution yet. Two examples of popular models used to generate synthetic datasets are the Erdős-Rényi (ER) and the Barabási-Albert (BA) models, each one with their distinct focus and limitations:
The ER model excels in creating graphs with uniform edge distribution, ideal for testing an algorithm’s ability to evenly space nodes and reduce edge crossings. However, it falls short in replicating the complex, non-uniform connections seen in real-world networks, limiting its applicability to scenarios requiring simplicity and randomness. Conversely, the BA model produces scale-free networks with a few highly connected nodes, reflecting the hierarchical structure of many natural and human-made systems. It challenges layout algorithms to effectively display these hubs without cluttering. The limitation here is its focus on growth and preferential attachment, which might not suit all types of networks, particularly those without clear hub structures.
As there is no universal solution for random graph generation, our recommendation is to try as much as possible to pay attention to research replicability criteria, such as redistributing the generated dataset as supplemental material in the paper.
5 Discussion, Limitations and Conclusion
Having reliable and easy ways to compare algorithm performances on a variety of graphs with different features is an important aspect of graph drawing research.
In this work, we presented a comprehensive benchmark dataset collection for graph layout algorithms. Compiling, organizing, and making a wide array of datasets with diverse characteristics accessible not only facilitates rigorous and fair comparisons of algorithmic performance but also addresses critical issues of replicability and reproducibility in research. The Graph Benchmark Datasets website, along with the efforts for long-term archival, is an effort towards maintaining these valuable resources available to the community.
The work we did for the collection process doesn’t come without limitations. We focused on the Graph Drawing conference as the main venue to begin collecting papers, which limits the completeness of our search. There could be many relevant datasets that we did not find to include here. Indeed, in no way we consider this collection comprehensive, but rather a starting point.
There is a large number of interesting follow-up questions that could be tackled starting from the data we collected, and information that could be gathered from cross-referencing the datasets with the literature. For instance, it would be interesting to study the spread of a dataset based on its features and how it has been distributed. The following is a chart comparing the year of publication of a dataset with the year of publication of papers that use the dataset:
Additional questions that would be interesting to explore could be:
- Has the type of benchmark datasets used in the literature changed over time?
- The datasets we collected definitely went through changes in the years — some merged, some underwent changes. How did these datasets evolve over time?
- How has the inclusion of supplemental material in literature changed?
We leave these questions for new and exciting future work. In the meantime, we hope that the Graph Benchmark Datasets website will be an appreciated resource for the community.
References
Adai, Alex T., Shailesh V. Date, Shannon Wieland, and Edward M. Marcotte. 2004. “LGL: Creating a Map of Protein Function with an Algorithm for Visualizing Very Large Biological Networks.” Journal of Molecular Biology 340 (1): 179–90. https://doi.org/10.1016/j.jmb.2004.04.047.
Ahmed, Reyan, Felice De Luca, Sabin Devkota, Stephen Kobourov, and Mingwei Li. 2020. “Graph Drawing via Gradient Descent, (GD)\(^2\).” In Lecture Notes in Computer Science, 3–17. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_1.
Alegrı́a, Carlos, Manuel Borrazzo, Giordano Da Lozzo, Giuseppe Di Battista, Fabrizio Frati, and Maurizio Patrignani. 2021. “Planar Straight-Line Realizations of 2-Trees with Prescribed Edge Lengths.” In Lecture Notes in Computer Science, 166–83. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_12.
Angori, Lorenzo, Walter Didimo, Fabrizio Montecchiani, Daniele Pagliuca, and Alessandra Tappini. 2019. “ChordLink: A New Hybrid Visualization Model.” In Lecture Notes in Computer Science, 276–90. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_22.
Arleo, Alessio, Walter Didimo, Giuseppe Liotta, and Fabrizio Montecchiani. 2019. “A Distributed Multilevel Force-Directed Algorithm.” IEEE Transactions on Parallel and Distributed Systems 30 (4): 754–65. https://doi.org/10.1109/tpds.2018.2869805.
Arleo, A., S. Miksch, and D. Archambault. 2022. “Event-Based Dynamic Graph Drawing Without the Agonizing Pain.” Computer Graphics Forum 41 (6): 226–44. https://doi.org/10.1111/cgf.14615.
Bach, Benjamin, Emmanuel Pietriga, and Jean-Daniel Fekete. 2014. “GraphDiaries: Animated Transitions andTemporal Navigation for Dynamic Networks.” IEEE Transactions on Visualization and Computer Graphics 20 (5): 740–54. https://doi.org/10.1109/tvcg.2013.254.
Bachmaier, Christian, Franz Josef Brandenburg, Philip Effinger, Carsten Gutwenger, Jyrki Katajainen, Karsten Klein, Miro Spönemann, Matthias Stegmaier, and Michael Wybrow. 2012. “The Open Graph Archive: A Community-Driven Effort.” In Graph Drawing, edited by Marc van Kreveld and Bettina Speckmann, 435–40. Berlin, Heidelberg: Springer Berlin Heidelberg.
Bachmaier, Christian, Andreas Gleißner, and Andreas Hofmeier. 2012. “DAGmar: Library for DAGs.” https://www.infosun.fim.uni-passau.de/~chris/down/MIP-1202.pdf.
Ballweg, Kathrin, Margit Pohl, Günter Wallner, and Tatiana von Landesberger. 2018. “Visual Similarity Perception of Directed Acyclic Graphs: A Study on Influencing Factors and Similarity Judgment Strategies.” Journal of Graph Algorithms and Applications 22 (3): 519–53. https://doi.org/10.7155/jgaa.00467.
Barnes, Josh, and Piet Hut. 1986. “A Hierarchical o(n Log n) Force-Calculation Algorithm.” Nature 324 (6096): 446–49. https://doi.org/10.1038/324446a0.
Barth, Wilhelm, Michael Jünger, and Petra Mutzel. 2002. “Simple and Efficient Bilayer Cross Counting.” In Graph Drawing, edited by Michael T. Goodrich and Stephen G. Kobourov, 130–41. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-36151-0_13.
Bast, Hannah, Patrick Brosi, and Sabine Storandt. 2020. “Metro Maps on Octilinear Grid Graphs.” Computer Graphics Forum 39 (3): 357–67. https://doi.org/10.1111/cgf.13986.
Batagelj, Vladimir, and Andrej Mrvar. 2006. “Pajek Datasets.” In. http://vlado.fmf.uni-lj.si/pub/networks/data/.
Batik, T., S. Terziadis, Y.-S. Wang, M. Nöllenburg, and H.-Y. Wu. 2022. “Shape-Guided Mixed Metro Map Layout.” Computer Graphics Forum 41 (7): 495–506. https://doi.org/10.1111/cgf.14695.
Battista, Giuseppe Di, Ashim Garg, Giuseppe Liotta, Armando Parise, Roberto Tamassia, Emanuele Tassinari, Francesco Vargiu, and Luca Vismara. 2000. “Drawing Directed Acyclic Graphs: An Experimental Study.” International Journal of Computational Geometry & Applications 10 (06): 623–48. https://doi.org/10.1142/s0218195900000358.
Battista, Giuseppe Di, Ashim Garg, Giuseppe Liotta, Roberto Tamassia, Emanuele Tassinari, and Francesco Vargiu. 1997. “An Experimental Comparison of Four Graph Drawing Algorithms.” Computational Geometry 7 (5-6): 303–25. https://doi.org/10.1016/s0925-7721(96)00005-3.
Bekos, M. A., D. J. C. Dekker, F. Frank, W. Meulemans, P. Rodgers, A. Schulz, and S. Wessel. 2022. “Computing Schematic Layouts for Spatial Hypergraphs on Concentric Circles and Grids.” Computer Graphics Forum 41 (6): 316–35. https://doi.org/10.1111/cgf.14497.
Bekos, Michael A., Henry Förster, Christian Geckeler, Lukas Holländer, Michael Kaufmann, Amadäus M. Spallek, and Jan Splett. 2018. “A Heuristic Approach Towards Drawings of Graphs with High Crossing Resolution.” In Lecture Notes in Computer Science, 271–85. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_19.
Bekos, Michael A., Michael Kaufmann, Katerina Potika, and Antonios Symvonis. 2007. “Line Crossing Minimization on Metro Maps.” In Graph Drawing, 231–42. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-77537-9_24.
Bertault, François. 2000. “A Force-Directed Algorithm That Preserves Edge-Crossing Properties.” Information Processing Letters 74 (1-2): 7–13. https://doi.org/10.1016/s0020-0190(00)00042-9.
Bhatt, Sandeep N., and Frank Thomson Leighton. 1984. “A Framework for Solving VLSI Graph Layout Problems.” Journal of Computer and System Sciences 28 (2): 300–343. https://doi.org/10.1016/0022-0000(84)90071-0.
Bhore, Sujoy, Maarten Löffler, Soeren Nickel, and Martin Nöllenburg. 2021. “Unit Disk Representations of Embedded Trees, Outerplanar and Multi-Legged Graphs.” In Lecture Notes in Computer Science, 304–17. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_22.
Biedl, Therese, and Veronika Irvine. 2018. “Drawing Bobbin Lace Graphs, or, Fundamental Cycles for a Subclass of Periodic Graphs.” In Lecture Notes in Computer Science, 140–52. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_12.
Binucci, Carla, Markus Chimani, Walter Didimo, Giuseppe Liotta, and Fabrizio Montecchiani. 2016. “Placing Arrows in Directed Graph Drawings.” In Lecture Notes in Computer Science, 44–51. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_4.
Binucci, Carla, Walter Didimo, Michael Kaufmann, Giuseppe Liotta, and Fabrizio Montecchiani. 2022. “Placing Arrows in Directed Graph Layouts: Algorithms and Experiments.” Computer Graphics Forum 41 (1): 364–76. https://doi.org/10.1111/cgf.14440.
Binucci, Carla, Walter Didimo, and Maurizio Patrignani. 2023. “St-Orientations with Few Transitive Edges.” In Graph Drawing and Network Visualization, edited by Patrizio Angelini and Reinhard von Hanxleden, 201–16. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-22203-0_15.
Binucci, Carla, Emilio Di Giacomo, Giuseppe Liotta, and Alessandra Tappini. 2021. “Quasi-Upward Planar Drawings with Minimum Curve Complexity.” In Lecture Notes in Computer Science, 195–209. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_14.
Börsig, Katharina, Ulrik Brandes, and Barna Pasztor. 2020. “Stochastic Gradient Descent Works Really Well for Stress Minimization.” In Lecture Notes in Computer Science, 18–25. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_2.
Brandes, Ulrik, and Boris Köpf. 2002. “Fast and Simple Horizontal Coordinate Assignment.” In Graph Drawing, edited by Petra Mutzel, Michael Jünger, and Sebastian Leipert, 31–44. Berlin, Heidelberg: Springer Berlin Heidelberg.
Brandes, Ulrik, and Christian Pich. 2006. “Eigensolver Methods for Progressive Multidimensional Scaling of Large Data.” In Proceedings of the 14th International Conference on Graph Drawing, 42–53. GD’06. Berlin, Heidelberg: Springer-Verlag. https://doi.org/10.5555/1758612.1758620.
———. 2009. “An Experimental Study on Distance-Based Graph Drawing.” In Graph Drawing, edited by Ioannis G. Tollis and Maurizio Patrignani, 218–29. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-00219-9_21.
Brandes, Ulrik, and Dorothea Wagner. 1998. “Using Graph Layout to Visualize Train Interconnection Data.” In Graph Drawing, edited by Sue H. Whitesides, 44–56. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-37623-2_4.
Buchheim, Christoph, Markus Chimani, Dietmar Ebner, Carsten Gutwenger, Michael Jünger, Gunnar W. Klau, Petra Mutzel, and René Weiskircher. 2008. “A Branch-and-Cut Approach to the Crossing Number Problem.” Discrete Optimization 5 (2): 373–88. https://doi.org/10.1016/j.disopt.2007.05.006.
Buchheim, Christoph, Dietmar Ebner, Michael Jünger, Gunnar W. Klau, Petra Mutzel, and René Weiskircher. 2006. “Exact Crossing Minimization.” In Graph Drawing, edited by Patrick Healy and Nikola S. Nikolov, 37–48. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/11618058_4.
Buchin, K., B. Speckmann, and K. Verbeek. 2011. “Flow Map Layout via Spiral Trees.” IEEE Transactions on Visualization and Computer Graphics 17 (12): 2536–44. https://doi.org/10.1109/tvcg.2011.202.
Burch, H., and B. Cheswick. 1999. “Mapping the Internet.” Computer 32 (4): 97–98. https://doi.org/10.1109/2.755008.
Burch, M., M. Hlawatsch, and D. Weiskopf. 2017. “Visualizing a Sequence of a Thousand Graphs (or Even More).” Computer Graphics Forum 36 (3): 261–71. https://doi.org/10.1111/cgf.13185.
Burch, M., C. Vehlow, F. Beck, S. Diehl, and D. Weiskopf. 2011. “Parallel Edge Splatting for Scalable Dynamic Graph Visualization.” IEEE Transactions on Visualization and Computer Graphics 17 (12): 2344–53. https://doi.org/10.1109/tvcg.2011.226.
Calamoneri, Tiziana, Valentino Di Donato, Diego Mariottini, and Maurizio Patrignani. 2018. “Visualizing Co-Phylogenetic Reconciliations.” In Lecture Notes in Computer Science, 334–47. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_27.
Cao, Nan, D. Gotz, J. Sun, and Huamin Qu. 2011. “DICON: Interactive Visual Analysis of Multidimensional Clusters.” IEEE Transactions on Visualization and Computer Graphics 17 (12): 2581–90. https://doi.org/10.1109/tvcg.2011.188.
Castermans, Thom, Mereke van Garderen, Wouter Meulemans, Martin Nöllenburg, and Xiaoru Yuan. 2018. “Short Plane Supports for Spatial Hypergraphs.” In Lecture Notes in Computer Science, 53–66. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_4.
Chen, Fati, Laurent Piccinini, Pascal Poncelet, and Arnaud Sallaberry. 2019. “Node Overlap Removal Algorithms: A Comparative Study.” In Lecture Notes in Computer Science, 179–92. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_14.
Chevalier, Cédric, and François Pellegrini. 2008. “PT-Scotch: A tool for efficient parallel graph ordering.” Parallel Computing 34 (6-8): 318–31. https://doi.org/10.1016/j.parco.2007.12.001.
Chimani, Markus, and Carsten Gutwenger. 2012. “Advances in the Planarization Method: Effective Multiple Edge Insertions.” In Graph Drawing, 87–98. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-25878-7_10.
Chimani, Markus, Carsten Gutwenger, and Petra Mutzel. 2006. “Experiments on Exact Crossing Minimization Using Column Generation.” In Experimental Algorithms, edited by Carme Àlvarez and María Serna, 303–15. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/11764298_28.
Chimani, Markus, Carsten Gutwenger, Petra Mutzel, and Hoi-Ming Wong. 2010. “Layer-Free Upward Crossing Minimization.” ACM J. Exp. Algorithmics 15 (March). https://doi.org/10.1145/1671970.1671975.
Chimani, Markus, Max Ilsen, and Tilo Wiedera. 2021. “Star-Struck by Fixed Embeddings: Modern Crossing Number Heuristics.” In Lecture Notes in Computer Science, 41–56. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_3.
Chimani, Markus, Karsten Klein, and Tilo Wiedera. 2016. “A Note on the Practicality of Maximal Planar Subgraph Algorithms.” In Graph Drawing and Network Visualization, edited by Yifan Hu and Martin Nöllenburg, 357–64. Cham: Springer International Publishing.
Chimani, Markus, Petra Mutzel, and Immanuel Bomze. 2008. “A New Approach to Exact Crossing Minimization.” In Algorithms - ESA 2008, 284–96. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-87744-8_24.
Chimani, Markus, and Tilo Wiedera. 2016b. “An ILP-based Proof System for the Crossing Number Problem.” In 24th Annual European Symposium on Algorithms (ESA 2016), edited by Piotr Sankowski and Christos Zaroliagis, 57:29:1–13. Leibniz International Proceedings in Informatics (LIPIcs). Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik. https://doi.org/10.4230/LIPIcs.ESA.2016.29.
———. 2016a. “An ILP-Based Proof System for the Crossing Number Problem.” In 24th Annual European Symposium on Algorithms (ESA 2016), edited by Piotr Sankowski and Christos Zaroliagis, 57:29:1–13. Leibniz International Proceedings in Informatics (LIPIcs). Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik. https://doi.org/10.4230/LIPIcs.ESA.2016.29.
Civril, Ali, Malik Magdon-Ismail, and Eli Bocek-Rivele. 2006. “SDE: Graph Drawing Using Spectral Distance Embedding.” In Graph Drawing, edited by Patrick Healy and Nikola S. Nikolov, 512–13. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/11618058_48.
Clancy, Kieran, Michael Haythorpe, and Alex Newcombe. 2019a. “A Survey of Graphs with Known or Bounded Crossing Numbers.” Australas. J Comb. 78: 209–96. https://api.semanticscholar.org/CorpusID:119313173.
———. 2019b. “An Effective Crossing Minimisation Heuristic Based on Star Insertion.” Journal of Graph Algorithms and Applications 23 (2): 135–66. https://doi.org/10.7155/jgaa.00487.
Cohen, Jonathan D. 1997. “Drawing Graphs to Convey Proximity: An Incremental Arrangement Method.” ACM Transactions on Computer-Human Interaction 4 (3): 197–229. https://doi.org/10.1145/264645.264657.
Col, Philipp de, Fabian Klute, and Martin Nöllenburg. 2019. “Mixed Linear Layouts: Complexity, Heuristics, and Experiments.” In Lecture Notes in Computer Science, 460–67. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_35.
Cornel, D., A. Konev, B. Sadransky, Z. Horváth, A. Brambilla, I. Viola, and J. Waser. 2016. “Composite Flow Maps.” Computer Graphics Forum 35 (3): 461–70. https://doi.org/10.1111/cgf.12922.
Cui, Weiwei, Hong Zhou, Huamin Qu, Pak Chung Wong, and Xiaoming Li. 2008. “Geometry-Based Edge Clustering for Graph Visualization.” IEEE Transactions on Visualization and Computer Graphics 14 (6): 1277–84. https://doi.org/10.1109/TVCG.2008.135.
Cypko, M. A., J. Wojdziak, M. Stoehr, B. Kirchner, B. Preim, A. Dietz, H. U. Lemke, and S. Oeltze-Jafra. 2017. “Visual Verification of Cancer Staging for Therapy Decision Support.” Computer Graphics Forum 36 (3): 109–20. https://doi.org/10.1111/cgf.13172.
Dang, T. N., N. Pendar, and A. G. Forbes. 2016. “TimeArcs: Visualizing Fluctuations in Dynamic Networks.” Computer Graphics Forum 35 (3): 61–69. https://doi.org/10.1111/cgf.12882.
Davidson, Ron, and David Harel. 1996. “Drawing Graphs Nicely Using Simulated Annealing.” ACM Trans. Graph. 15 (4): 301–31. https://doi.org/10.1145/234535.234538.
Davis, Timothy A., and Yifan Hu. 2011. “The University of Florida Sparse Matrix Collection.” ACM Trans. Math. Softw. 38 (1). https://doi.org/10.1145/2049662.2049663.
De Luca, Felice, Emilio Di Giacomo, Walter Didimo, Stephen Kobourov, and Giuseppe Liotta. 2017. “An Experimental Study on the Ply Number of Straight-Line Drawings.” In WALCOM: Algorithms and Computation, edited by Sheung-Hung Poon, Md. Saidur Rahman, and Hsu-Chun Yen, 135–48. Cham: Springer International Publishing.
De Luca, Felice, Md. Iqbal Hossain, and Stephen Kobourov. 2019. “Symmetry Detection and Classification in Drawings of Graphs.” In Graph Drawing and Network Visualization, edited by Daniel Archambault and Csaba D. Tóth, 499–513. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_38.
Demel, Almut, Dominik Dürrschnabel, Tamara Mchedlidze, Marcel Radermacher, and Lasse Wulf. 2018. “A Greedy Heuristic for Crossing-Angle Maximization.” In Lecture Notes in Computer Science, 286–99. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_20.
Devkota, Sabin, Reyan Ahmed, Felice De Luca, Katherine E. Isaacs, and Stephen Kobourov. 2019. “Stress-Plus-x (SPX) Graph Layout.” In Lecture Notes in Computer Science, 291–304. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_23.
Devkota, Sabin, and Katherine E. Isaacs. 2018. “CFGExplorer: Designing a Visual Control Flow Analytics System Around Basic Program Analysis Operations.” Computer Graphics Forum 37 (3): 453–64. https://doi.org/10.1111/cgf.13433.
Di Bartolomeo, Sara, Tarik Crnovrsanin, David Saffo, Eduardo Puerta, Connor Wilson, and Cody Dunne. 2024. “Evaluating Graph Layout Algorithms: A Systematic Review of Methods and Best Practices.” Computer Graphics Forum n/a (n/a): e15073. https://doi.org/10.1111/cgf.15073.
Di Bartolomeo, Sara, Alexis Pister, Paolo Buono, Catherine Plaisant, Cody Dunne, and Jean-Daniel Fekete. 2022. “Six Methods for Transforming Layered Hypergraphs to Apply Layered Graph Layout Algorithms.” Computer Graphics Forum 41 (3): 259–70. https://doi.org/10.1111/cgf.14538.
Di Bartolomeo, Sara, Mirek Riedewald, Wolfgang Gatterbauer, and Cody Dunne. 2022. “STRATISFIMAL LAYOUT: A Modular Optimization Model for Laying Out Layered Node-Link Network Visualizations.” IEEE Transactions on Visualization and Computer Graphics 28 (1): 324–34. https://doi.org/10.1109/tvcg.2021.3114756.
Di Bartolomeo, Sara, Yixuan Zhang, Fangfang Sheng, and Cody Dunne. 2021. “Sequence Braiding: Visual Overviews of Temporal Event Sequences and Attributes.” IEEE Transactions on Visualization and Computer Graphics 27 (2): 1353–63. https://doi.org/10.1109/tvcg.2020.3030442.
Di Battista, Giuseppe, Ashim Garg, and Giuseppe Liotta. 1995. “An Experimental Comparison of Three Graph Drawing Algorithms (Extended Abstract).” In Proceedings of the Eleventh Annual Symposium on Computational Geometry, 306–15. SCG ’95. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/220279.220312.
Didimo, Walter, Luca Giamminonni, Giuseppe Liotta, Fabrizio Montecchiani, and Daniele Pagliuca. 2018. “A Visual Analytics System to Support Tax Evasion Discovery.” Decision Support Systems 110: 71–83. https://doi.org/10.1016/j.dss.2018.03.008.
Didimo, Walter, Giuseppe Liotta, and Fabrizio Montecchiani. 2019. “A Survey on Graph Drawing Beyond Planarity.” ACM Computing Surveys 52 (1): 1–37. https://doi.org/10.1145/3301281.
Didimo, Walter, Giuseppe Liotta, and Maurizio Patrignani. 2018. “Bend-Minimum Orthogonal Drawings in Quadratic Time.” In Lecture Notes in Computer Science, 481–94. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_34.
Dijk, Thomas C. van, Martin Fink, Norbert Fischer, Fabian Lipp, Peter Markfelder, Alexander Ravsky, Subhash Suri, and Alexander Wolff. 2016. “Block Crossings in Storyline Visualizations.” In Lecture Notes in Computer Science, 382–98. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_30.
Dijk, Thomas C. van, Fabian Lipp, Peter Markfelder, and Alexander Wolff. 2018. “Computing Storyline Visualizations with Few Block Crossings.” In Lecture Notes in Computer Science, 365–78. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_29.
Donati, Beatrice, Christian Baudet, Blerina Sinaimeri, Pierluigi Crescenzi, and Marie-France Sagot. 2015. “EUCALYPT: Efficient Tree Reconciliation Enumerator.” Algorithms for Molecular Biology 10: 3. https://doi.org/10.1186/s13015-014-0031-3.
Dwyer, Tim, Nathalie Henry Riche, Kim Marriott, and Christopher Mears. 2013. “Edge Compression Techniques for Visualization of Dense Directed Graphs.” IEEE Transactions on Visualization and Computer Graphics 19 (12): 2596–2605. https://doi.org/10.1109/tvcg.2013.151.
EADES, P. 1984. “A Heuristic for Graph Drawing.” Congressus Numerantium 42: 149–60. https://cir.nii.ac.jp/crid/1573387448853684864.
Eades, Peter, Quan Nguyen, and Seok-Hee Hong. 2018. “Drawing Big Graphs Using Spectral Sparsification.” In Lecture Notes in Computer Science, 272–86. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_22.
Elzen, Stef van den, Danny Holten, Jorik Blaas, and Jarke J. van Wijk. 2013. “Reordering Massive Sequence Views: Enabling Temporal and Structural Analysis of Dynamic Networks.” In 2013 IEEE Pacific Visualization Symposium (PacificVis). IEEE. https://doi.org/10.1109/pacificvis.2013.6596125.
Ersoy, O., C. Hurter, Fernando V. Paulovich, G. Cantareiro, and A. Telea. 2011. “Skeleton-Based Edge Bundling for Graph Visualization.” IEEE Transactions on Visualization and Computer Graphics 17 (12): 2364–73. https://doi.org/10.1109/tvcg.2011.233.
Feng, Wenzheng, Jie Tang, Tracy Xiao Liu, Shuhuai Zhang, and Jian Guan. 2019. “Understanding Dropouts in MOOCs.” In Proceedings of the 33rd AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v33i01.3301517.
Firman, Oksana, Philipp Kindermann, Alexander Ravsky, Alexander Wolff, and Johannes Zink. 2019. “Computing Height-Optimal Tangles Faster.” In Lecture Notes in Computer Science, 203–15. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_16.
Forster, Michael. 2002. “Applying Crossing Reduction Strategies to Layered Compound Graphs.” In Graph Drawing, edited by Michael T. Goodrich and Stephen G. Kobourov, 276–84. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-36151-0_26.
———. 2005. “A Fast and Simple Heuristic for Constrained Two-Level Crossing Reduction.” In Graph Drawing, 206–16. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-31843-9_22.
Förster, Henry, Michael Kaufmann, and Chrysanthi N. Raftopoulou. 2021. “Recognizing and Embedding Simple Optimal 2-Planar Graphs.” In Lecture Notes in Computer Science, 87–100. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_6.
Frick, Arne, Andreas Ludwig, and Heiko Mehldau. 1995. “A Fast Adaptive Layout Algorithm for Undirected Graphs (Extended Abstract and System Demonstration).” In Graph Drawing, edited by Roberto Tamassia and Ioannis G. Tollis, 388–403. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-58950-3_393.
Frishman, Yaniv, and Ayellet Tal. 2007. “Multi-Level Graph Layout on the GPU.” IEEE Transactions on Visualization and Computer Graphics 13 (6): 1310–19. https://doi.org/10.1109/TVCG.2007.70580.
Frishman, Y., and A. Tal. 2008. “Online Dynamic Graph Drawing.” IEEE Transactions on Visualization and Computer Graphics 14 (4): 727–40. https://doi.org/10.1109/tvcg.2008.11.
Frishman, Y., and Ayellet Tal. 2004. “Dynamic Drawing of Clustered Graphs.” In IEEE Symposium on Information Visualization, 191–98. https://doi.org/10.1109/INFVIS.2004.18.
Fruchterman, Thomas M. J., and Edward M. Reingold. 1991. “Graph Drawing by Force-Directed Placement.” Software: Practice and Experience 21 (11): 1129–64. https://doi.org/10.1002/spe.4380211102.
Fulek, Radoslav, and Csaba D. Tóth. 2018. “Crossing Minimization in Perturbed Drawings.” In Lecture Notes in Computer Science, 229–41. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_16.
Gajer, Pawel, and Stephen G. Kobourov. 2000. “GRIP: Graph DRawing with Intelligent Placement.” In Proceedings of the 8th International Symposium on Graph Drawing, 222–28. GD ’00. Berlin, Heidelberg: Springer-Verlag. https://doi.org/10.5555/647552.729406.
Gange, Graeme, Peter J. Stuckey, and Kim Marriott. 2011. “Optimal k-Level Planarization and Crossing Minimization.” In Graph Drawing, 238–49. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-18469-7_22.
Gansner, E. R., Yifan Hu, and S. North. 2013. “A Maxent-Stress Model for Graph Layout.” IEEE Transactions on Visualization and Computer Graphics 19 (6): 927–40. https://doi.org/10.1109/tvcg.2012.299.
Gansner, E. R., Y. Koren, and S. C. North. 2005. “Topological Fisheye Views for Visualizing Large Graphs.” IEEE Transactions on Visualization and Computer Graphics 11 (4): 457–68. https://doi.org/10.1109/tvcg.2005.66.
Gansner, E. R., E. Koutsofios, S. C. North, and K.-P. Vo. 1993. “A Technique for Drawing Directed Graphs.” IEEE Transactions on Software Engineering 19 (3): 214–30. https://doi.org/10.1109/32.221135.
Gansner, Emden R., and Yehuda Koren. 2006. “Improved Circular Layouts.” In Graph Drawing, 386–98. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-70904-6_37.
Gansner, Emden R., Yehuda Koren, and Stephen North. 2005. “Graph Drawing by Stress Majorization.” In Graph Drawing, 239–50. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-31843-9_25.
Gansner, Emden R., and Stephen C. North. 2000. “An Open Graph Visualization System and Its Applications to Software Engineering.” Softw. Pract. Exper. 30 (11): 1203–33.
Giacomo, Emilio Di, Walter Didimo, Giuseppe Liotta, Fabrizio Montecchiani, and Alessandra Tappini. 2020. “Storyline Visualizations with Ubiquitous Actors.” In Lecture Notes in Computer Science, 324–32. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_25.
Gibson, Helen, Joe Faith, and Paul Vickers. 2012. “A Survey of Two-Dimensional Graph Layout Techniques for Information Visualisation.” Information Visualization 12 (3-4): 324–57. https://doi.org/10.1177/1473871612455749.
Giovannangeli, Loann, Frederic Lalanne, David Auber, Romain Giot, and Romain Bourqui. 2021. “Deep Neural Network for DrawiNg Networks.” In Lecture Notes in Computer Science, 375–90. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_27.
Giovannangeli, Loann, Frederic Lalanne, Romain Giot, and Romain Bourqui. 2023. “FORBID: Fast Overlap Removal by Stochastic GradIent Descent for Graph Drawing.” In Graph Drawing and Network Visualization, edited by Patrizio Angelini and Reinhard von Hanxleden, 61–76. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-22203-0_6.
Gove, R. 2019. “A Random Sampling o(n) Force-Calculation Algorithm for Graph Layouts.” Computer Graphics Forum 38 (3): 739–51. https://doi.org/10.1111/cgf.13724.
Grabowicz, Przemyslaw A, Luca Maria Aiello, and Filippo Menczer. 2014. “Fast Filtering and Animation of Large Dynamic Networks.” EPJ Data Science 3 (1). https://doi.org/10.1140/epjds/s13688-014-0027-8.
Gray, Kathryn, Mingwei Li, Reyan Ahmed, and Stephen Kobourov. 2023. “Visualizing Evolving Trees.” In Graph Drawing and Network Visualization, edited by Patrizio Angelini and Reinhard von Hanxleden, 319–35. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-22203-0_23.
Greilich, Martin, Michael Burch, and Stephan Diehl. 2009. “Visualizing the Evolution of Compound Digraphs with TimeArcTrees.” Computer Graphics Forum 28 (3): 975–82. https://doi.org/10.1111/j.1467-8659.2009.01451.x.
Gronemann, Martin. 2016. “Bitonic St-Orderings for Upward Planar Graphs.” In Lecture Notes in Computer Science, 222–35. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_18.
Gronemann, Martin, Michael Jünger, Frauke Liers, and Francesco Mambelli. 2016. “Crossing Minimization in Storyline Visualization.” In Lecture Notes in Computer Science, 367–81. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_29.
Gutwenger, Carsten. 2010. “Application of SPQR-Trees in the Planarization Approach for Drawing Graphs.” PhD thesis, Technische Universität Dortmund. https://eldorado.tu-dortmund.de/handle/2003/27430.
Gutwenger, Carsten, and Petra Mutzel. 2004. “An Experimental Study of Crossing Minimization Heuristics.” In Graph Drawing, 13–24. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-24595-7_2.
Hachul, Stefan, and Michael Juenger. 2005. “Large-Graph Layout with the Fast Multipole Multilevel Method.” Working Paper. Universität zu Köln. https://kups.ub.uni-koeln.de/54892/.
Hachul, Stefan, and Michael Jünger. 2005. “Drawing Large Graphs with a Potential-Field-Based Multilevel Algorithm.” In Graph Drawing, 285–95. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-31843-9_29.
———. 2006. “An Experimental Comparison of Fast Algorithms for Drawing General Large Graphs,” 235–50. https://doi.org/10.1007/11618058_22.
Harel, David, and Yehuda Koren. 2001. “A Fast Multi-Scale Method for Drawing Large Graphs.” In Graph Drawing, edited by Joe Marks, 183–96. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-44541-2_18.
Heinsohn, Niklas, and Michael Kaufmann. 2018. “An Interactive Tool to Explore and Improve the Ply Number of Drawings.” In Lecture Notes in Computer Science, 38–51. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_4.
Henry, Nathalie, Jean-Daniel Fekete, and Michael J. McGuffin. 2007. “NodeTrix: A Hybrid Visualization of Social Networks.” IEEE Transactions on Visualization and Computer Graphics 13 (6): 1302–9. https://doi.org/10.1109/tvcg.2007.70582.
Heymann, S. 2009. “CPAN-Explorer, an Interactive Exploration of the Perl Ecosystem.” Gephi Blog. https://gephi.wordpress.com/2009/06/25/cpan-explorer-an-interactive-exploration-of-the-perl-ecosystem/.
Hoffswell, Jane, Alan Borning, and Jeffrey Heer. 2018. “SetCoLa: High-Level Constraints for Graph Layout.” Computer Graphics Forum 37 (3): 537–48. https://doi.org/10.1111/cgf.13440.
Hofmann, J., M. Größler, M. Rubio-Sánchez, P.-P. Pichler, and D. J. Lehmann. 2017. “Visual Exploration of Global Trade Networks with Time-Dependent and Weighted Hierarchical Edge Bundles on GPU.” Computer Graphics Forum 36 (3): 273–82. https://doi.org/10.1111/cgf.13186.
Holten, D. 2006. “Hierarchical Edge Bundles: Visualization of Adjacency Relations in Hierarchical Data.” IEEE Transactions on Visualization and Computer Graphics 12 (5): 741–48. https://doi.org/10.1109/tvcg.2006.147.
Holten, Danny, and Jarke J. Van Wijk. 2009. “Force-Directed Edge Bundling for Graph Visualization.” Computer Graphics Forum 28 (3): 983–90. https://doi.org/10.1111/j.1467-8659.2009.01450.x.
Holten, Danny, and Jarke J. van Wijk. 2009. “Force-Directed Edge Bundling for Graph Visualization.” Computer Graphics Forum 28 (3): 983–90. https://doi.org/10.1111/j.1467-8659.2009.01450.x.
Hong, Seok-Hee, Peter Eades, Marnijati Torkel, Ziyang Wang, David Chae, Sungpack Hong, Daniel Langerenken, and Hassan Chafi. 2019. “Multi-Level Graph Drawing Using Infomap Clustering.” In Lecture Notes in Computer Science, 139–46. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_11.
Hu, Weihua, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. 2020. “Open Graph Benchmark: Datasets for Machine Learning on Graphs.” In Proceedings of the 34th International Conference on Neural Information Processing Systems. NIPS ’20. Red Hook, NY, USA: Curran Associates Inc.
Hu, Y. F. 2005. “Efficient and High Quality Force-Directed Graph Drawing.” The Mathematica Journal 10: 37–71. http://www.mathematica-journal.com/issue/v10i1/contents/graph_draw/graph_draw.pdf.
Huang, Xiaoke, Ye Zhao, Chao Ma, Jing Yang, Xinyue Ye, and Chong Zhang. 2016. “TrajGraph: A Graph-Based Visual Analytics Approach to Studying Urban Network Centralities Using Taxi Trajectory Data.” IEEE Transactions on Visualization and Computer Graphics 22 (1): 160–69. https://doi.org/10.1109/tvcg.2015.2467771.
Hummel, Matthias, Fabian Klute, Soeren Nickel, and Martin Nöllenburg. 2019. “Maximizing Ink in Partial Edge Drawings of k-Plane Graphs.” In Lecture Notes in Computer Science, 323–36. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_25.
Isella, Lorenzo, Juliette Stehlé, Alain Barrat, Ciro Cattuto, Jean-François Pinton, and Wouter Van den Broeck. 2011. “What’s in a Crowd? Analysis of Face-to-Face Behavioral Networks.” Journal of Theoretical Biology 271 (1): 166–80. https://doi.org/10.1016/j.jtbi.2010.11.033.
Isenberg, Petra, Florian Heimerl, Steffen Koch, Tobias Isenberg, Panpan Xu, Chad Stolper, Michael Sedlmair, Jian Chen, Torsten Möller, and John Stasko. 2017. “Vispubdata.org: A Metadata Collection about IEEE Visualization (VIS) Publications.” IEEE Transactions on Visualization and Computer Graphics 23 (9): 2199–2206. https://doi.org/10.1109/TVCG.2016.2615308.
Jabrayilov, Adalat, Sven Mallach, Petra Mutzel, Ulf Rüegg, and Reinhard von Hanxleden. 2016. “Compact Layered Drawings of General Directed Graphs.” In Lecture Notes in Computer Science, 209–21. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_17.
Jacomy, Mathieu, Tommaso Venturini, Sebastien Heymann, and Mathieu Bastian. 2014. “ForceAtlas2, a Continuous Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software.” Edited by Mark R. Muldoon. PLoS ONE 9 (6): e98679. https://doi.org/10.1371/journal.pone.0098679.
Jolly, Mitchell. 2017. “Chess Game Dataset (Lichess).” Kaggle. https://www.kaggle.com/datasets/datasnaek/chess?resource=download.
Jünger, Michael, and Petra Mutzel. 1996. “Exact and Heuristic Algorithms for 2-Layer Straightline Crossing Minimization.” In Graph Drawing, edited by Franz J. Brandenburg, 337–48. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/BFb0021817.
Jünger, Michael, Petra Mutzel, and Christiane Spisla. 2018. “A Flow Formulation for Horizontal Coordinate Assignment with Prescribed Width.” In Lecture Notes in Computer Science, 187–99. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_13.
Kamada, Tomihisa, and Satoru Kawai. 1989. “An Algorithm for Drawing General Undirected Graphs.” Information Processing Letters 31 (1): 7–15. https://doi.org/10.1016/0020-0190(89)90102-6.
Kindermann, Philipp, Wouter Meulemans, and André Schulz. 2018. “Experimental Analysis of the Accessibility of Drawings with Few Segments.” Journal of Graph Algorithms and Applications 22 (3): 501–18. https://doi.org/10.7155/jgaa.00474.
Klammler, Moritz, Tamara Mchedlidze, and Alexey Pak. 2018. “Aesthetic Discrimination of Graph Layouts.” In Graph Drawing and Network Visualization, edited by Therese Biedl and Andreas Kerren, 169–84. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_12.
Klawitter, Jonathan, Tamara Mchedlidze, and Martin Nöllenburg. 2018. “Experimental Evaluation of Book Drawing Algorithms.” In Lecture Notes in Computer Science, 224–38. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_19.
Klawitter, Jonathan, and Johannes Zink. 2021. “Upward Planar Drawings with Three and More Slopes.” In Lecture Notes in Computer Science, 149–65. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_11.
Kleinberg, Jon. 2002. “The Structure of Information Networks.” https://www.cs.cornell.edu/courses/cs685/2002fa/.
Klemz, Boris, Kristin Knorr, Meghana M. Reddy, and Felix Schröder. 2021. “Simplifying Non-Simple Fan-Planar Drawings.” In Lecture Notes in Computer Science, 57–71. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_4.
Klimt, Bryan, and Yiming Yang. 2004. “Introducing the Enron Corpus.” In International Conference on Email and Anti-Spam.
Knuth, Donald Ervin. 2009. The Stanford Graphbase: A Platform for Combinatorial Computing. Addison-Wesley.
Koch, Thorsten, Alexander Martin, and Stefan Voß. 2001. “SteinLib: An Updated Library on Steiner Tree Problems in Graphs.” In Steiner Trees in Industry, edited by Xiu Zhen Cheng and Ding-Zhu Du, 285–325. Boston, MA: Springer US. https://doi.org/10.1007/978-1-4613-0255-1_9.
Koren, Y. 2005. “Drawing Graphs by Eigenvectors: Theory and Practice.” Computers & Mathematics with Applications 49 (11): 1867–88. https://doi.org/10.1016/j.camwa.2004.08.015.
Koren, Yehuda, L. Carmel, and D. Harel. 2002. “ACE: A Fast Multiscale Eigenvectors Computation for Drawing Huge Graphs.” In IEEE Symposium on Information Visualization, 2002. INFOVIS 2002., 137–44. https://doi.org/10.1109/INFVIS.2002.1173159.
Kruiger, J. F., P. E. Rauber, R. M. Martins, A. Kerren, S. Kobourov, and A. C. Telea. 2017. “Graph Layouts by t-SNE.” Computer Graphics Forum 36 (3): 283–94. https://doi.org/10.1111/cgf.13187.
Landesberger, Tatiana von, Felix Brodkorb, Philipp Roskosch, Natalia Andrienko, Gennady Andrienko, and Andreas Kerren. 2016. “MobilityGraphs: Visual Analysis of Mass Mobility Dynamics via Spatio-Temporal Graphs and Clustering.” IEEE Transactions on Visualization and Computer Graphics 22 (1): 11–20. https://doi.org/10.1109/tvcg.2015.2468111.
Leskovec, Jure, Lada A. Adamic, and Bernardo A. Huberman. 2007. “The Dynamics of Viral Marketing.” ACM Trans. Web 1 (1): 5–es. https://doi.org/10.1145/1232722.1232727.
Leskovec, Jure, Jon Kleinberg, and Christos Faloutsos. 2005. “Graphs over Time: Densification Laws, Shrinking Diameters and Possible Explanations.” In Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, 177–87. KDD ’05. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/1081870.1081893.
Leskovec, Jure, and Andrej Krevl. 2014. “SNAP Datasets: Stanford Large Network Dataset Collection.” http://snap.stanford.edu/data.
Letunic, Ivica, and Peer Bork. 2021. “Interactive Tree Of Life (iTOL) v5: an online tool for phylogenetic tree display and annotation.” Nucleic Acids Research 49 (W1): W293–96. https://doi.org/10.1093/nar/gkab301.
Lim, HeuiChan, and Stephen Kobourov. 2021. “Visualizing JIT Compiler Graphs.” In Lecture Notes in Computer Science, 138–46. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_10.
Lin, Yu-Ru, Jimeng Sun, Nan Cao, and Shixia Liu. 2010. “ContexTour: Contextual Contour Visual Analysis on Dynamic Multi-Relational Clustering.” In Proceedings of the 2010 SIAM International Conference on Data Mining. Society for Industrial; Applied Mathematics. https://doi.org/10.1137/1.9781611972801.37.
Liu, Mengchen, Jiaxin Shi, Zhen Li, Chongxuan Li, Jun Zhu, and Shixia Liu. 2017. “Towards Better Analysis of Deep Convolutional Neural Networks.” IEEE Transactions on Visualization and Computer Graphics 23 (1): 91–100. https://doi.org/10.1109/tvcg.2016.2598831.
Liu, Shixia, Yingcai Wu, Enxun Wei, Mengchen Liu, and Yang Liu. 2013. “StoryFlow: Tracking the Evolution of Stories.” IEEE Transactions on Visualization and Computer Graphics 19 (12): 2436–45. https://doi.org/10.1109/tvcg.2013.196.
Lukasczyk, Jonas, Gunther Weber, Ross Maciejewski, Christoph Garth, and Heike Leitte. 2017. “Nested Tracking Graphs.” Computer Graphics Forum 36 (3): 12–22. https://doi.org/10.1111/cgf.13164.
Maddison, David, Katja Schulz, and Wayne Maddison. 2007. “The Tree of Life Web Project*.” Zootaxa 1668 (December): 19–40. https://doi.org/10.11646/zootaxa.1668.1.4.
Mallach, Sven. 2019. “A Natural Quadratic Approach to the Generalized Graph Layering Problem.” In Lecture Notes in Computer Science, 532–44. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_40.
Malone, D. W. 1975. “An Introduction to the Application of Interpretive Structural Modeling.” Proceedings of the IEEE 63 (3): 397–404. https://doi.org/10.1109/PROC.1975.9765.
Marner, Michael R., Ross T. Smith, Bruce H. Thomas, Karsten Klein, Peter Eades, and Seok-Hee Hong. 2014. “GION: Interactively Untangling Large Graphs on Wall-Sized Displays.” In Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, 113–24. Springer International Publishing. https://doi.org/10.1007/978-3-662-45803-7_10.
McAuley, Julian, and Jure Leskovec. 2012. “Learning to Discover Social Circles in Ego Networks.” In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1, 539–47. NIPS’12. Red Hook, NY, USA: Curran Associates Inc.
Meidiana, Amyra, Seok-Hee Hong, and Peter Eades. 2020. “New Quality Metrics for Dynamic Graph Drawing.” In Graph Drawing and Network Visualization, edited by David Auber and Pavel Valtr, 450–65. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_35.
———. 2023. “Shape-Faithful Graph Drawings.” In Graph Drawing and Network Visualization, edited by Patrizio Angelini and Reinhard von Hanxleden, 93–108. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-22203-0_8.
Meidiana, Amyra, Seok-Hee Hong, Peter Eades, and Daniel Keim. 2019. “A Quality Metric for Visualization of Clusters in Graphs.” In Lecture Notes in Computer Science, 125–38. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_10.
Meidiana, Amyra, Seok-Hee Hong, Marnijati Torkel, Shijun Cai, and Peter Eades. 2020. “Sublinear Time Force Computation for Big Complex Network Visualization.” Computer Graphics Forum 39 (3): 579–91. https://doi.org/10.1111/cgf.14003.
Mennens, Robin J. P., Roeland Scheepens, and Michel A. Westenberg. 2019. “A Stable Graph Layout Algorithm for Processes.” Computer Graphics Forum 38 (3): 725–37. https://doi.org/10.1111/cgf.13723.
Meulemans, Wouter, Nathalie Henry Riche, Bettina Speckmann, Basak Alper, and Tim Dwyer. 2013. “KelpFusion: A Hybrid Set Visualization Technique.” IEEE Transactions on Visualization and Computer Graphics 19 (11): 1846–58. https://doi.org/10.1109/tvcg.2013.76.
Miller, Jacob, Vahan Huroyan, and Stephen Kobourov. 2023. “Spherical Graph Drawing by Multi-Dimensional Scaling.” In Graph Drawing and Network Visualization, edited by Patrizio Angelini and Reinhard von Hanxleden, 77–92. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-22203-0_7.
Minghim, Rosane, Fernando Paulovich, and Alneu Lopes. 2006. “Content-Based Text Mapping Using Multi-Dimensional Projections for Exploration of Document Collections.” In Visualization and Data Analysis, 6060:60600S. https://doi.org/10.1117/12.650880.
Misue, Kazuo, and Katsuya Akasaka. 2019. “Graph Drawing with Morphing Partial Edges.” In Lecture Notes in Computer Science, 337–49. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_26.
Mizuno, Kazuyo, Hsiang-Yun Wu, Shigeo Takahashi, and Takeo Igarashi. 2019. “Optimizing Stepwise Animation in Dynamic Set Diagrams.” Computer Graphics Forum 38 (3): 13–24. https://doi.org/10.1111/cgf.13668.
Muelder, Chris, and Kwan Liu Ma. 2008a. “Rapid Graph Layout Using Space Filling Curves.” IEEE Transactions on Visualization and Computer Graphics 14 (6): 1301–8. https://doi.org/10.1109/TVCG.2008.158.
Muelder, Chris, and Kwan-Liu Ma. 2008b. “A Treemap Based Method for Rapid Layout of Large Graphs.” In 2008 IEEE Pacific Visualization Symposium, 231–38. https://doi.org/10.1109/PACIFICVIS.2008.4475481.
Nachmanson, Lev, Arlind Nocaj, Sergey Bereg, Leishi Zhang, and Alexander Holroyd. 2017. “Node Overlap Removal by Growing a Tree.” Journal of Graph Algorithms and Applications 21 (5): 857–72. https://doi.org/10.7155/jgaa.00442.
Ni, Chien-Chun, Yu-Yao Lin, Jie Gao, and Xianfeng Gu. 2018. “Network Alignment by Discrete Ollivier-Ricci Flow.” In Lecture Notes in Computer Science, 447–62. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_32.
Nickel, Soeren, Max Sondag, Wouter Meulemans, Markus Chimani, Stephen Kobourov, Jaakko Peltonen, and Martin Nöllenburg. 2019. “Computing Stable Demers Cartograms.” In Lecture Notes in Computer Science, 46–60. Springer International Publishing. https://doi.org/10.1007/978-3-030-35802-0_4.
Niedermann, Benjamin, and Ignaz Rutter. 2020. “An Integer-Linear Program for Bend-Minimization in Ortho-Radial Drawings.” In Lecture Notes in Computer Science, 235–49. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_19.
Noack, Andreas. 2004. “An Energy Model for Visual Graph Clustering.” In Graph Drawing, edited by Giuseppe Liotta, 425–36. Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-24595-7_40.
Nocaj, Arlind, Mark Ortmann, and Ulrik Brandes. 2015. “Untangling the Hairballs of Multi-Centered, Small-World Online Social Media Networks.” Journal of Graph Algorithms and Applications : JGAA 19 (2): 595–618. https://doi.org/10.7155/jgaa.00370.
Nollenburg, M, and A Wolff. 2011. “Drawing and Labeling High-Quality Metro Maps by Mixed-Integer Programming.” IEEE Transactions on Visualization and Computer Graphics 17 (5): 626–41. https://doi.org/10.1109/tvcg.2010.81.
Nöllenburg, Martin. 2010. “An Improved Algorithm for the Metro-Line Crossing Minimization Problem.” In Graph Drawing, 381–92. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-11805-0_36.
Nöllenburg, Martin, Anaïs Villedieu, and Jules Wulms. 2021. “Layered Area-Proportional Rectangle Contact Representations.” In Lecture Notes in Computer Science, 318–26. Springer International Publishing. https://doi.org/10.1007/978-3-030-92931-2_23.
North Dakota State University, and American Mathematical Society. 2006. “The Mathematics Genealogy Project.” United States: American Mathematical Society. https://genealogy.math.ndsu.nodak.edu/index.php.
Novák, Petr, Pavel Neumann, and Jiří Macas. 2010. “Graph-Based Clustering and Characterization of Repetitive Sequences in Next-Generation Sequencing Data.” BMC Bioinformatics 11 (1): 378. https://doi.org/10.1186/1471-2105-11-378.
Ogawa, Michael, and Kwan-Liu Ma. 2010. “Software Evolution Storylines.” In Proceedings of the 5th International Symposium on Software Visualization - SOFTVIS 10. ACM Press. https://doi.org/10.1145/1879211.1879219.
Oikonomou, Anargyros, and Antonios Symvonis. 2018. “Monotone Drawings of k-Inner Planar Graphs.” In Lecture Notes in Computer Science, 347–53. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_24.
Olszewski, Maya, Jeff Meder, Emmanuel Kieffer, Raphaël Bleuse, Martin Rosalie, Grégoire Danoy, and Pascal Bouvry. 2018. “Visualizing the Template of a Chaotic Attractor.” In Lecture Notes in Computer Science, 106–19. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_8.
Ortali, Giacomo, and Ioannis G. Tollis. 2018. “Algorithms and Bounds for Drawing Directed Graphs.” In Lecture Notes in Computer Science, 579–92. Springer International Publishing. https://doi.org/10.1007/978-3-030-04414-5_41.
Ortmann, Mark, Mirza Klimenta, and Ulrik Brandes. 2017. “A Sparse Stress Model.” Journal of Graph Algorithms and Applications 21 (5): 791–821. https://doi.org/10.7155/jgaa.00440.
Padia, Kalpesh, Kaveen Herath Bandara, and Christopher G. Healey. 2019. “A System for Generating Storyline Visualizations Using Hierarchical Task Network Planning.” Computers & Graphics 78 (February): 64–75. https://doi.org/10.1016/j.cag.2018.11.004.
Padia, Kalpesh, Kaveen Bandara, and Christopher Healey. 2018. “Yarn: Generating Storyline Visualizations Using HTN Planning.” Proceedings of Graphics Interface 2018 Toronto: 26–33. https://doi.org/10.20380/GI2018.05.
Palmer, Glenn, Roseanne W McManus, Vito D’Orazio, Michael R Kenwick, Mikaela Karstens, Chase Bloch, Nick Dietrich, Kayla Kahn, Kellan Ritter, and Michael J Soules. 2022. “The MID5 Dataset, 2011–2014: Procedures, Coding Rules, and Description.” Conflict Management and Peace Science 39 (4): 470–82. https://doi.org/10.1177/0738894221995743.
Pellegrini, François. 2012. “Scotch and PT-Scotch Graph Partitioning Software: An Overview.” In Combinatorial Scientific Computing, edited by Olaf Schenk Uwe Naumann, 373–406. Chapman and Hall/CRC. https://doi.org/10.1201/b11644-15.
Perri, Vincenzo, and Ingo Scholtes. 2020. “HOTVis: Higher-Order Time-Aware Visualisation of Dynamic Graphs.” In Lecture Notes in Computer Science, 99–114. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_8.
Preiner, R., J. Schmidt, K. Krösl, T. Schreck, and G. Mistelbauer. 2020. “Augmenting Node-Link Diagrams with Topographic Attribute Maps.” Computer Graphics Forum 39 (3): 369–81. https://doi.org/10.1111/cgf.13987.
Purchase, Helen C., Daniel Archambault, Stephen Kobourov, Martin Nöllenburg, Sergey Pupyrev, and Hsiang-Yun Wu. 2020. “The Turing Test for Graph Drawing Algorithms.” In Lecture Notes in Computer Science, 466–81. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_36.
Qu, Botong, Eugene Zhang, and Yue Zhang. 2022. “Automatic Polygon Layout for Primal-Dual Visualization of Hypergraphs.” IEEE Transactions on Visualization and Computer Graphics 28 (1): 633–42. https://doi.org/10.1109/tvcg.2021.3114759.
Raj, Mukund, and Ross T. Whitaker. 2018. “Anisotropic Radial Layout for Visualizing Centrality and Structure in Graphs.” In Lecture Notes in Computer Science, 351–64. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_28.
Red, Veronica, Eric D. Kelsic, Peter J. Mucha, and Mason A. Porter. 2011. “Comparing Community Structure to Characteristics in Online Collegiate Social Networks.” SIAM Review 53 (3): 526–43. https://doi.org/10.1137/080734315.
Rossi, Ryan A., and Nesreen K. Ahmed. 2015. “The Network Data Repository with Interactive Graph Analytics and Visualization.” In AAAI. http://networkrepository.com.
Rüegg, Ulf, Thorsten Ehlers, Miro Spönemann, and Reinhard von Hanxleden. 2016. “A Generalization of the Directed Graph Layering Problem.” In Lecture Notes in Computer Science, 196–208. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_16.
Saket, Bahador, Carlos Scheidegger, and Stephen Kobourov. 2016. “Comparing Node-Link and Node-Link-Group Visualizations from an Enjoyment Perspective.” Computer Graphics Forum 35 (3): 41–50. https://doi.org/10.1111/cgf.12880.
Sander, Georg. 1996. “Layout of Compound Directed Graphs.” FB INFORMATIK, UNIVERSITAT DES SAARLANDES.
Simonetto, Paolo, Daniel Archambault, and Stephen Kobourov. 2018. “Drawing Dynamic Graphs Without Timeslices.” In Lecture Notes in Computer Science, 394–409. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_31.
Skambath, Malte, and Till Tantau. 2016. “Offline Drawing of Dynamic Trees: Algorithmics and Document Integration.” In Lecture Notes in Computer Science, 572–86. Springer International Publishing. https://doi.org/10.1007/978-3-319-50106-2_44.
Soper, A. J., C. Walshaw, and M. Cross. 2004. “A Combined Evolutionary Search and Multilevel Optimisation Approach to Graph-Partitioning.” Journal of Global Optimization 29 (2): 225–41. https://doi.org/10.1023/B:JOGO.0000042115.44455.f3.
Subramanian, Arvind, and Shang-Jin Wei. 2007. “The WTO Promotes Trade, Strongly but Unevenly.” Journal of International Economics 72 (1): 151–75. https://doi.org/10.1016/j.jinteco.2006.07.007.
Sugiyama, Kozo, Shojiro Tagawa, and Mitsuhiko Toda. 1981. “Methods for Visual Understanding of Hierarchical System Structures.” IEEE Transactions on Systems, Man, and Cybernetics 11 (2): 109–25. https://doi.org/10.1109/tsmc.1981.4308636.
Tanahashi, Y., and Kwan-Liu Ma. 2012. “Design Considerations for Optimizing Storyline Visualizations.” IEEE Transactions on Visualization and Computer Graphics 18 (12): 2679–88. https://doi.org/10.1109/tvcg.2012.212.
Tanahashi, Yuzuru, Chien-Hsin Hsueh, and Kwan-Liu Ma. 2015. “An Efficient Framework for Generating Storyline Visualizations from Streaming Data.” IEEE Transactions on Visualization and Computer Graphics 21 (6): 730–42. https://doi.org/10.1109/tvcg.2015.2392771.
Traud, Amanda L., Peter J. Mucha, and Mason A. Porter. 2011. “Social Structure of Facebook Networks.” http://arxiv.org/abs/1102.2116.
Van De Bunt, Gerhard G., Marijtje A. J. Van Duijn, and Tom A. B. Snijders. 1999. “Friendship Networks Through Time: An Actor-Oriented Dynamic Statistical Network Model.” Computational & Mathematical Organization Theory 5 (2): 167–92. https://doi.org/10.1023/A:1009683123448.
Wallinger, Markus, Daniel Archambault, David Auber, Martin Nollenburg, and Jaakko Peltonen. 2022. “Edge-Path Bundling: A Less Ambiguous Edge Bundling Approach.” IEEE Transactions on Visualization and Computer Graphics 28 (1): 313–23. https://doi.org/10.1109/tvcg.2021.3114795.
Wallinger, Markus, Daniel Archambault, David Auber, Martin Nöllenburg, and Jaakko Peltonen. 2023. “Faster Edge-Path Bundling Through Graph Spanners.” Computer Graphics Forum n/a (n/a). https://doi.org/10.1111/cgf.14789.
Walshaw, C. 2001. “A Multilevel Algorithm for Force-Directed Graph Drawing.” In Graph Drawing, edited by Joe Marks, 171–82. Berlin, Heidelberg: Springer Berlin Heidelberg.
Walshaw, C., and M. Cross. 2000. “Mesh Partitioning: A Multilevel Balancing and Refinement Algorithm.” SIAM J. Sci. Comput. 22 (1): 63–80. https://doi.org/10.1137/S1064827598337373.
Walter, Julian, Johannes Zink, Joachim Baumeister, and Alexander Wolff. 2020. “Layered Drawing of Undirected Graphs with Generalized Port Constraints.” In Lecture Notes in Computer Science, 220–34. Springer International Publishing. https://doi.org/10.1007/978-3-030-68766-3_18.
Wang, Yunhai, Yanyan Wang, Yinqi Sun, Lifeng Zhu, Kecheng Lu, Chi-Wing Fu, Michael Sedlmair, Oliver Deussen, and Baoquan Chen. 2018. “Revisiting Stress Majorization as a Unified Framework for Interactive Constrained Graph Visualization.” IEEE Transactions on Visualization and Computer Graphics 24 (1): 489–99. https://doi.org/10.1109/TVCG.2017.2745919.
Wang, Yunhai, Yanyan Wang, Haifeng Zhang, Yinqi Sun, Chi-Wing Fu, Michael Sedlmair, Baoquan Chen, and Oliver Deussen. 2019. “Structure-Aware Fisheye Views for Efficient Large Graph Exploration.” IEEE Transactions on Visualization and Computer Graphics 25 (1): 566–75. https://doi.org/10.1109/TVCG.2018.2864911.
Wang, Yunhai, Mingliang Xue, Yanyan Wang, Xinyuan Yan, Baoquan Chen, Chi-Wing Fu, and Christophe Hurter. 2020. “Interactive Structure-Aware Blending of Diverse Edge Bundling Visualizations.” IEEE Transactions on Visualization and Computer Graphics 26 (1): 687–96. https://doi.org/10.1109/TVCG.2019.2934805.
Welch, E., and S. Kobourov. 2017. “Measuring Symmetry in Drawings of Graphs.” Computer Graphics Forum 36 (3): 341–51. https://doi.org/10.1111/cgf.13192.
Wongsuphasawat, Kanit, Daniel Smilkov, James Wexler, Jimbo Wilson, Dandelion Mane, Doug Fritz, Dilip Krishnan, Fernanda B. Viegas, and Martin Wattenberg. 2018. “Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow.” IEEE Transactions on Visualization and Computer Graphics 24 (1): 1–12. https://doi.org/10.1109/tvcg.2017.2744878.
Wu, Hsiang-Yun, Martin Nollenburg, and Ivan Viola. 2020. “Multi-Level Area Balancing of Clustered Graphs.” IEEE Transactions on Visualization and Computer Graphics, 1–1. https://doi.org/10.1109/tvcg.2020.3038154.
Wu, Jieting, Jianping Zeng, Feiyu Zhu, and Hongfeng Yu. 2018. “MLSEB: Edge Bundling Using Moving Least Squares Approximation.” In Lecture Notes in Computer Science, 379–93. Springer International Publishing. https://doi.org/10.1007/978-3-319-73915-1_30.
Xue, Mingliang, Zhi Wang, Fahai Zhong, Yong Wang, Mingliang Xu, Oliver Deussen, and Yunhai Wang. 2023. “Taurus: Towards a Unified Force Representation and Universal Solver for Graph Layout.” IEEE Transactions on Visualization and Computer Graphics 29 (1): 886–95. https://doi.org/10.1109/TVCG.2022.3209371.
Zachary, Wayne W. 1977. “An Information Flow Model for Conflict and Fission in Small Groups.” Journal of Anthropological Research 33 (4): 452–73. http://www.jstor.org/stable/3629752.
Zarate, David Cheng, Pierre Le Bodic, Tim Dwyer, Graeme Gange, and Peter Stuckey. 2018. “Optimal Sankey Diagrams via Integer Programming.” In 2018 IEEE Pacific Visualization Symposium (PacificVis), 135–39. https://doi.org/10.1109/PacificVis.2018.00025.
Zeng, W., Q. Shen, Y. Jiang, and A. Telea. 2019. “Route-Aware Edge Bundling for Visualizing Origin-Destination Trails in Urban Traffic.” Computer Graphics Forum 38 (3): 581–93. https://doi.org/10.1111/cgf.13712.
Zhang, Yonghe, and Yanyan Li. 2010. “BaryLayout: A Simple Algorithm for Fast Drawing Large Graphs.” In 2010 International Conference on Computational Intelligence and Software Engineering. IEEE. https://doi.org/10.1109/cise.2010.5677225.
Zhao, Ying, Haojin Jiang, Qian Chen, Yaqi Qin, Huixuan Xie, Yitao Wu, Shixia Liu, Zhiguang Zhou, Jiazhi Xia, and Fangfang Zhou. 2021. “Preserving Minority Structures in Graph Sampling.” IEEE Transactions on Visualization and Computer Graphics 27 (2): 1698–708. https://doi.org/10.1109/tvcg.2020.3030428.
Zheng, Jonathan X., Samraat Pawar, and Dan F. M. Goodman. 2019. “Graph Drawing by Stochastic Gradient Descent.” IEEE Transactions on Visualization and Computer Graphics 25 (9): 2738–48. https://doi.org/10.1109/TVCG.2018.2859997.
Zhong, Fahai, Mingliang Xue, Jian Zhang, Fan Zhang, Rui Ban, Oliver Deussen, and Yunhai Wang. 2023. “Force-Directed Graph Layouts Revisited: A New Force Based on the t-Distribution.” IEEE Transactions on Visualization and Computer Graphics, 1–14. https://doi.org/10.1109/TVCG.2023.3238821.
Zhu, Minfeng, Wei Chen, Yuanzhe Hu, Yuxuan Hou, Liangjun Liu, and Kaiyuan Zhang. 2021. “DRGraph: An Efficient Graph Layout Algorithm for Large-Scale Graphs by Dimensionality Reduction.” IEEE Transactions on Visualization and Computer Graphics 27 (2): 1666–76. https://doi.org/10.1109/TVCG.2020.3030447.