This page summarizes the work I did as a PhD Student at the Center for Mathematics and Computer Science (CWI), and at VU University Amsterdam.

Books

  1. Networks of Sensors – Operation and Control [pdf]
    PhD Thesis, Vrije Uiversiteit Amsterdam, ISBN: 978-94-028-0004-3

Papers

  1. Discovery of structured optimal policies in Markov Decision Processes
    [under review]
  2. Learning Optimal Policies in MDPs with Value Function Discovery [pdf]
    ACM SIGMETRICS Performance Evaluation Review, 43(2): 7 – 9, 2015
  3. Throughput Modeling of the IEEE MAC for Sensor Networks [pdf]
    ACM SIGMETRICS Performance Evaluation Review, 44(4), 2-9, 2017
  4. Value Function Discovery in Markov Decision Processes with Evolutionary Algorithms [pdf]
    IEEE Transactions on Systems, Man, and Cybernetics: Systems
  5. On the Control of a Queueing System with Aging State Information [pdf]
    Stochastic Models, 31(4): 588-617, 2015
  6. Efficient Resource Allocation for the Service Placement Problem in Next-generation Internet
    Math. Problems in Engineering, vol. 2015, 15 pages, 2015.
  7. Outlier Preservation by Dimensionality Reduction Techniques [pdf]
    Int. J. of Data Analysis Techniques and Strategies 7(3): 231 – 252, 2015
  8. An Overview of Centralised Middleware Components for Sensor Networks [pdf]
    Int. J. of Ad Hoc and Ubiquitous Computing, 2016 Vol.21, No.3, pp.180 – 193
  9. Optimal query assignment for wireless sensor networks
    Int. J. Electron. Commun. (AEÜ) 69: 1102–1112, 2015.

 

Students

Name Date Title Role
Anne Frances Appelman 2015 Exploratory data analysis of sensor measurements CWI supervisor
Vlad Iordanou 2012/ 2013 A Sensor Services Platform for Centralized Data Collection & Sharing CWI supervisor
Paul Kooij 2012 Trendanalyse huurwoningmarkt – verkorten inschrijfduur en leegstandtijd. Second reader
Marjolein Schipper 2011/2012 Tijdelijke snelheidsbeperkingen Second reader
Elena Pupazan 2011/2012 Data Modeling First reader
Chantal Epskamp 2011 Fraude in de jaarrekening. Verbetering van de accountantscontrole binnen Deloitte. VU supervisor
Marjolein Schipper 2011 Multivariate Data Analyse. VU supervisor
Mark Blom 2011 Weerstandsvermogen bij gemeentes. Hoe kunnen gemeentes worden geadviseerd op het gebied van risico’s? VU supervisor
Kevin Duijndam 2011 AdWords Bid Optimisation. Second reader