Metric k-center explained

In graph theory, the metric -center problem or vertex k-center problem is a classical combinatorial optimization problem studied in theoretical computer science that is NP-hard. Given cities with specified distances, one wants to build warehouses in different cities and minimize the maximum distance of a city to a warehouse. In graph theory, this means finding a set of vertices for which the largest distance of any point to its closest vertex in the -set is minimum. The vertices must be in a metric space, providing a complete graph that satisfies the triangle inequality. It has application in facility location and clustering.^[1] ^[2]

Formal definition

The problem was first proposed by Hakimi in 1964.^[3]

Let

(X,d)

be a metric space where

is a set and

is a metric
A set

V\subseteql{X}

, is provided together with a parameter

. The goal is to find a subset

l{C}\subseteqV

with

|l{C}|=k

such that the maximum distance of a point in

to the closest point in

l{C}

is minimized. The problem can be formally defined as follows:
For a metric space (

l{X}

,d),

Input: a set

V\subseteql{X}

, and a parameter

Output: a set

l{C}\subseteqV

points.

Goal: Minimize the cost

r^l{C}(V)=\underset{v\inV}{max}

d(v,

l{C}

)

That is, every point in a cluster is in distance at most

r^l{C}(V)

from its respective center. ^[4]

The k-Center Clustering problem can also be defined on a complete undirected graph G = (V, E) as follows:
Given a complete undirected graph G = (V, E) with distances d(v_i, v_j) ∈ N satisfying the triangle inequality, find a subset C ⊆ V with |C| = k while minimizing:

max_vmin_cd(v,c)

Computational complexity

In a complete undirected graph G = (V, E), if we sort the edges in non-decreasing order of the distances: d(e₁) ≤ d(e₂) ≤ ... ≤ d(e_m) and let G_i = (V, E_i), where E_i = . The k-center problem is equivalent to finding the smallest index i such that G_i has a dominating set of size at most k.

Although Dominating Set is NP-complete, the k-center problem remains NP-hard. This is clear, since the optimality of a given feasible solution for the k-center problem can be determined through the Dominating Set reduction only if we know in first place the size of the optimal solution (i.e. the smallest index i such that G_i has a dominating set of size at most k), which is precisely the difficult core of the NP-Hard problems. Although a Turing reduction can get around this issue by trying all values of k.

Approximations

A simple greedy algorithm

A simple greedy approximation algorithm that achieves an approximation factor of 2 builds

l{C}

using a farthest-first traversal in k iterations. This algorithm simply chooses the point farthest away from the current set of centers in each iteration as the new center. It can be described as follows:

Pick an arbitrary point

\bar{c}₁

into

C₁

For every point

v\inV

compute

d_1[v]

from

\bar{c}₁

Pick the point

\bar{c}₂

with highest distance from

\bar{c}₁

Add it to the set of centers and denote this expanded set of centers as

C₂

. Continue this till k centers are found

Running time

The i^th iteration of choosing the i^th center takes

l{O}(n)

time.

There are k such iterations.
Thus, overall the algorithm takes

l{O}(nk)

time.

Proving the approximation factor

The solution obtained using the simple greedy algorithm is a 2-approximation to the optimal solution. This section focuses on proving this approximation factor.

Given a set of n points

V\subseteql{X}

, belonging to a metric space (

l{X}

,d), the greedy K-center algorithm computes a set K of k centers, such that K is a 2-approximation to the optimal k-center clustering of V.

i.e.

r^K(V)\leq2r^opt(V,it{k})

^[4]

This theorem can be proven using two cases as follows,

Case 1: Every cluster of

l{C}_opt

contains exactly one point of

Consider a point

v\inV

\bar{c}

be the center it belongs to in

l{C}_opt

\bar{k}

be the center of

that is in

\Pi(l{C}_opt,\bar{c})

d(v,\bar{c})=d(v,l{C}_opt)\leqr^opt(V,k)

Similarly,

d(\bar{k},\bar{c})=d(\bar{k},l{C}_opt)\leqr^opt

By the triangle inequality:

d(v,\bar{k})\leqd(v,\bar{c})+d(\bar{c},\bar{k})\leq2r^opt

Case 2: There are two centers

\bar{k}

and

\bar{u}

that are both in

\Pi(l{C}_opt,\bar{c})

, for some

\bar{c}\inl{C}_opt

(By pigeon hole principle, this is the only other possibility)

Assume, without loss of generality, that

\bar{u}

was added later to the center set

by the greedy algorithm, say in i^th iteration.

But since the greedy algorithm always chooses the point furthest away from the current set of centers, we have that

\bar{k}\inl{C}_i-1

and,

\begin{align} r^K(V)\leq

	l{C
r
	i-1

}(\mathbf)&=d(\bar,\mathcal_)\\ &\leq d(\bar,\bar)\\ &\leq d(\bar,\bar)+d(\bar,\bar)\\ &\leq 2r^ \end^[4]

Another 2-factor approximation algorithm

Another algorithm with the same approximation factor takes advantage of the fact that the k-Center problem is equivalent to finding the smallest index i such that G_i has a dominating set of size at most k and computes a maximal independent set of G_i, looking for the smallest index i that has a maximal independent set with a size of at least k.It is not possible to find an approximation algorithm with an approximation factor of 2 - ε for any ε > 0, unless P = NP.Furthermore, the distances of all edges in G must satisfy the triangle inequality if the k-center problem is to be approximated within any constant factor, unless P = NP.

Parameterized approximations

It can be shown that the k-Center problem is W[2]-hard to approximate within a factor of 2 - ε for any ε > 0, when using k as the parameter.^[5] This is also true when parameterizing by the doubling dimension (in fact the dimension of a Manhattan metric), unless P=NP.^[6] When considering the combined parameter given by k and the doubling dimension, k-Center is still W[1]-hard but it is possible to obtain a parameterized approximation scheme.^[7] This is even possible for the variant with vertex capacities, which bound how many vertices can be assigned to an opened center of the solution.^[8]

Approximation algorithms

P ≠ NP

, the vertex k-center problem can not be (optimally) solved in polynomial time. However, there are some polynomial time approximation algorithms that get near-optimal solutions. Specifically, 2-approximated solutions. Actually, if

P ≠ NP

the best possible solution that can be achieved by a polynomial time algorithm is a 2-approximated one.^[9] ^[10] ^[11] ^[12] In the context of a minimization problem, such as the vertex k-center problem, a 2-approximated solution is any solution

such that

r(C')\le2 x r(OPT)

, where

r(OPT)

is the size of an optimal solution. An algorithm that guarantees to generate 2-approximated solutions is known as a 2-approximation algorithm. The main 2-approximated algorithms for the vertex k-center problem reported in the literature are the Sh algorithm,^[13] the HS algorithm, and the Gon algorithm. Even though these algorithms are the (polynomial) best possible ones, their performance on most benchmark datasets is very deficient. Because of this, many heuristics and metaheuristics have been developed through the time. Contrary to common sense, one of the most practical (polynomial) heuristics for the vertex k-center problem is based on the CDS algorithm, which is a 3-approximation algorithm^[14]

The Sh algorithm

Formally characterized by David Shmoys in 1995, the Sh algorithm takes as input a complete undirected graph

G=(V,E)

, a positive integer

, and an assumption

on what the optimal solution size is. The Sh algorithm works as follows: selects the first center

c₁

at random. So far, the solution consists of only one vertex,

C=\{c_1\}

. Next, selects center

c₂

at random from the set containing all the vertices whose distance from

is greater than

2 x r

. At this point,

C=\{c_1,c_2\}

. Finally, selects the remaining

k-2

centers the same way

c₂

was selected. The complexity of the Sh algorithm is

O(kn)

, where

is the number of vertices.

The HS algorithm

Proposed by Dorit Hochbaum and David Shmoys in 1985, the HS algorithm takes the Sh algorithm as basis. By noticing that the value of

r(OPT)

must equals the cost of some edge in

, and since there are

O(n²⁾

edges in

, the HS algorithm basically repeats the Sh algorithm with every edge cost. The complexity of the HS algorithm is

O(n⁴⁾

. However, by running a binary search over the ordered set of edge costs, its complexity is reduced to

O(n²logn)

The Gon algorithm

Proposed independently by Teofilo Gonzalez, and by Martin Dyer and Alan Frieze in 1985, the Gon algorithm is basically a more powerful version of the Sh algorithm. While the Sh algorithm requires a guess

r(OPT)

, the Gon algorithm prescinds from such guess by noticing that if any set of vertices at distance greater than

2 x r(OPT)

exists, then the farthest vertex must be inside such set. Therefore, instead of computing at each iteration the set of vertices at distance greater than

2 x r

and then selecting a random vertex, the Gon algorithm simply selects the farthest vertex from every partial solution

. The complexity of the Gon algorithm is

O(kn)

, where

is the number of vertices.

The CDS algorithm

Proposed by García Díaz et al. in 2017, the CDS algorithm is a 3-approximation algorithm that takes ideas from the Gon algorithm (farthest point heuristic), the HS algorithm (parametric pruning), and the relationship between the vertex k-center problem and the Dominating Set problem. The CDS algorithm has a complexity of

O(n⁴⁾

. However, by performing a binary search over the ordered set of edge costs, a more efficiente heuristic named CDSh is proposed. The CDSh algorithm complexity is

O(n²logn)

. Despite the suboptimal performance of the CDS algorithm, and the heuristic performance of CDSh, both present a much better performance than the Sh, HS, and Gon algorithms.

Parameterized approximations

It can be shown that the k-Center problem is W[2]-hard to approximate within a factor of 2 - ε for any ε > 0, when using k as the parameter.^[15] This is also true when parameterizing by the doubling dimension (in fact the dimension of a Manhattan metric), unless P=NP.^[16] When considering the combined parameter given by k and the doubling dimension, k-Center is still W[1]-hard but it is possible to obtain a parameterized approximation scheme.^[17] This is even possible for the variant with vertex capacities, which bound how many vertices can be assigned to an opened center of the solution.^[18]

Experimental comparison

Some of the most widely used benchmark datasets for the vertex k-center problem are the pmed instances from OR-Lib.,^[19] and some instances from TSP-Lib.^[20] Table 1 shows the mean and standard deviation of the experimental approximation factors of the solutions generated by each algorithm over the 40 pmed instances from OR-Lib

Table 1. Experimental approximation factor over pmed instances from OR-Lib!Algorithm!
*\mu*

!
*\sigma*

!Complexity
HS	1.532	0.175	O(n²logn)
Gon	1.503	0.122	O(kn)
CDSh	1.035	0.031	O(n²logn)
CDS	1.020	0.027	O(n⁴⁾

Table 2. Experimental approximation factor over instances from TSP-Lib!Algorithm!
*\mu*

!
*\sigma*

!Algorithm
Gon	1.396	0.091	O(kn)
HS	1.318	0.108	O(n²logn)
CDSh	1.124	0.065	O(n²logn)
CDS	1.042	0.038	O(n⁴⁾

Polynomial heuristics

Greedy pure algorithm

The greedy pure algorithm (or Gr) follows the core idea of greedy algorithms: to take optimal local decisions. In the case of the vertex k-center problem, the optimal local decision consists in selecting each center in such a way that the size of the solution (covering radius) is minimum at each iteration. In other words, the first center selected is the one that solves the 1-center problem. The second center selected is the one that, along with the previous center, generates a solution with minimum covering radius. The remaining centers are selected the same way. The complexity of the Gr algorithm is

O(kn²⁾

.^[21] The empirical performance of the Gr algorithm is poor on most benchmark instances.

Scoring algorithm

The Scoring algorithm (or Scr) was introduced by Jurij Mihelič and Borut Robič in 2005.^[22] This algorithm takes advantage of the reduction from the vertex k-center problem to the minimum dominating set problem. The problem is solved by pruning the input graph with every possible value of the optimal solution size and then solving the minimum dominating set problem heuristically. This heuristic follows the lazy principle, which takes every decision as slow as possible (opossed to the greedy strategy). The complexity of the Scr algorithm is

O(n⁴⁾

. The empirical performance of the Scr algorithm is very good on most benchmark instances. However, its running time rapidly becomes impractical as the input grows. So, it seems to be a good algorithm only for small instances.

References

Pacheco. Joaquín A.. Casado. Silvia. December 2005. Solving two location models with few facilities by using a hybrid heuristic: a real health resources case. Computers & Operations Research. 32. 12. 3075–3091. 10.1016/j.cor.2004.04.009. 0305-0548.
Kaveh. A.. Nasr. H.. August 2011. Solving the conditional and unconditional -center problem with modified harmony search: A real case study. Scientia Iranica. 18. 4. 867–877. 10.1016/j.scient.2011.07.010. 1026-3098. free.
Hakimi. S. L.. 1964. Optimum Locations of Switching Centers and the Absolute Centers and Medians of a Graph. Operations Research. 12. 3. 450–459. 168125. 10.1287/opre.12.3.450.
Book: Sariel Har-Peled
. Har-peled, Sariel . Sariel Har-Peled . Geometric Approximation Algorithms . 2011 . 978-0821849118 . American Mathematical Society . Boston, MA, USA.
Feldmann . Andreas Emil . 2019-03-01 . Fixed-Parameter Approximations for k-Center Problems in Low Highway Dimension Graphs . Algorithmica . en . 81 . 3 . 1031–1052 . 10.1007/s00453-018-0455-0 . 46886829 . 1432-0541.
Book: Feder . Tomás . Greene . Daniel . Proceedings of the twentieth annual ACM symposium on Theory of computing - STOC '88 . Optimal algorithms for approximate clustering . 1988-01-01 . https://doi.org/10.1145/62212.62255 . New York, NY, USA . Association for Computing Machinery . 434–444 . 10.1145/62212.62255 . 978-0-89791-264-8. 658151 .
Feldmann . Andreas Emil . Marx . Dániel . 2020-07-01 . The Parameterized Hardness of the k-Center Problem in Transportation Networks . Algorithmica . en . 82 . 7 . 1989–2005 . 10.1007/s00453-020-00683-w . 3532236 . 1432-0541.
Book: Feldmann . Andreas Emil . Vu . Tung Anh . Graph-Theoretic Concepts in Computer Science . Generalized $$k$$-Center: Distinguishing Doubling and Highway Dimension . 2022 . Bekos . Michael A. . Kaufmann . Michael . https://link.springer.com/chapter/10.1007/978-3-031-15914-5_16 . Lecture Notes in Computer Science . 13453 . en . Cham . Springer International Publishing . 215–229 . 10.1007/978-3-031-15914-5_16 . 2209.00675 . 978-3-031-15914-5.
Kariv. O.. Hakimi. S. L.. December 1979. An Algorithmic Approach to Network Location Problems. I: The p-Centers. SIAM Journal on Applied Mathematics. 37. 3. 513–538. 10.1137/0137040. 0036-1399.
Gonzalez. Teofilo F.. 1985. Clustering to minimize the maximum intercluster distance. Theoretical Computer Science. 38. 293–306. 10.1016/0304-3975(85)90224-5. 0304-3975. free.
Dyer. M.E. Frieze. A.M. February 1985. A simple heuristic for the p-centre problem. Operations Research Letters. 3. 6. 285–288. 10.1016/0167-6377(85)90002-1. 0167-6377.
Hochbaum . Dorit S. . Dorit S. Hochbaum. Shmoys . David B. . David Shmoys. May 1985. A Best Possible Heuristic for the k-Center Problem. Mathematics of Operations Research. 10. 2. 180–184. 10.1287/moor.10.2.180. 0364-765X.
Book: Shmoys, David B.. Combinatorial Optimization . Computing near-optimal solutions to combinatorial optimization problems . 1995. 20. 355––397. 10.1.1.33.1719. 10.1090/dimacs/020/07. DIMACS Series in Discrete Mathematics and Theoretical Computer Science. 9780821802397.
Garcia-Diaz. Jesus. Sanchez-Hernandez. Jairo. Menchaca-Mendez. Ricardo. Menchaca-Mendez. Rolando. 2017-07-01. When a worse approximation factor gives better performance: a 3-approximation algorithm for the vertex k-center problem. Journal of Heuristics. 23. 5. 349–366. 10.1007/s10732-017-9345-x. 254500532 . 1381-1231.
Feldmann . Andreas Emil . 2019-03-01 . Fixed-Parameter Approximations for k-Center Problems in Low Highway Dimension Graphs . Algorithmica . en . 81 . 3 . 1031–1052 . 10.1007/s00453-018-0455-0 . 1605.02530 . 46886829 . 1432-0541.
Book: Feder . Tomás . Greene . Daniel . Proceedings of the twentieth annual ACM symposium on Theory of computing - STOC '88 . Optimal algorithms for approximate clustering . 1988-01-01 . https://doi.org/10.1145/62212.62255 . New York, NY, USA . Association for Computing Machinery . 434–444 . 10.1145/62212.62255 . 978-0-89791-264-8. 658151 .
Feldmann . Andreas Emil . Marx . Dániel . 2020-07-01 . The Parameterized Hardness of the k-Center Problem in Transportation Networks . Algorithmica . en . 82 . 7 . 1989–2005 . 10.1007/s00453-020-00683-w . 3532236 . 1432-0541. 1802.08563 .
Book: Feldmann . Andreas Emil . Vu . Tung Anh . Graph-Theoretic Concepts in Computer Science . Generalized $$k$$-Center: Distinguishing Doubling and Highway Dimension . 2022 . Bekos . Michael A. . Kaufmann . Michael . https://link.springer.com/chapter/10.1007/978-3-031-15914-5_16 . Lecture Notes in Computer Science . 13453 . en . Cham . Springer International Publishing . 215–229 . 10.1007/978-3-031-15914-5_16 . 2209.00675 . 978-3-031-15914-5.
Beasley. J. E.. 1990. OR-Library: Distributing Test Problems by Electronic Mail. The Journal of the Operational Research Society. 41. 11. 1069–1072. 10.2307/2582903. 2582903.
Reinelt. Gerhard. November 1991. TSPLIB—A Traveling Salesman Problem Library. ORSA Journal on Computing. 3. 4. 376–384. 10.1287/ijoc.3.4.376. 0899-1499.
Book: Rana. Rattan. Garg. Deepak. 2009 IEEE International Advance Computing Conference . Heuristic Approaches for K-Center Problem . March 2009. 332–335 . IEEE. 10.1109/iadcc.2009.4809031. 9781424429271. 12453616 .
Mihelič . Jurij . Robič . Borut . 2005 . Solving the k-center Problem Efficiently with a Dominating Set Algorithm . Journal of Computing and Information Technology . 13 . 3 . 225 . 10.2498/cit.2005.03.05 . 1330-1136 . free . 10.1.1.205.3118 .

Metric k-center explained

Formal definition

Computational complexity

Approximations

A simple greedy algorithm

Running time

Proving the approximation factor

Another 2-factor approximation algorithm

Parameterized approximations

Approximation algorithms

The Sh algorithm

The HS algorithm

The Gon algorithm

The CDS algorithm

Parameterized approximations

Experimental comparison

Polynomial heuristics

Greedy pure algorithm

Scoring algorithm

See also

References