In a groundbreaking study published in Nature Mental Health, researchers from Queen Mary University of London have developed a new method for predicting dementia with over 80% accuracy up to nine years before a clinical diagnosis. This method, which outperforms traditional memory tests and measurements of brain shrinkage, relies on detecting changes in the brains default mode network (DMN) using functional magnetic resonance imaging (fMRI).

Dementia is a collective term used to describe a variety of conditions characterized by the gradual decline in cognitive function severe enough to interfere with daily life and independent functioning. It affects memory, thinking, orientation, comprehension, calculation, learning capacity, language, and judgment.

Alzheimers disease is the most common cause of dementia, accounting for 60-70% of cases. Other types include vascular dementia, dementia with Lewy bodies, and frontotemporal dementia.

Dementia is a progressive condition, meaning symptoms worsen over time, often leading to significant impairments in daily activities and quality of life. Currently, there is no cure for dementia, and treatments primarily focus on managing symptoms and supporting patients and their caregivers.

Early diagnosis is important because it opens the door to interventions that might slow the progression of the disease, improve quality of life, and provide individuals and their families more time to plan for the future. Traditional diagnostic methods, such as memory tests and brain scans to detect atrophy, often catch the disease only after significant neural damage has occurred. These methods are not sensitive enough to detect the very early changes in brain function that precede clinical symptoms.

Predicting who is going to get dementia in the future will be vital for developing treatments that can prevent the irreversible loss of brain cells that causes the symptoms of dementia, said Charles Marshall, who led the research team within the Centre for Preventive Neurology at Queen Marys Wolfson Institute of Population Health. Although we are getting better at detecting the proteins in the brain that can cause Alzheimers disease, many people live for decades with these proteins in their brain without developing symptoms of dementia.

We hope that the measure of brain function that we have developed will allow us to be much more precise about whether someone is actually going to develop dementia, and how soon, so that we can identify whether they might benefit from future treatments.

The study involved a nested case-control design using data from the UK Biobank, a large-scale biomedical database. The researchers focused on a subset of participants who had undergone functional magnetic resonance imaging (fMRI) scans and either had a diagnosis of dementia or developed it later. The sample consisted of 148 dementia cases and 1,030 matched controls, ensuring a robust comparison group by matching on age, sex, ethnicity, handedness, and the geographical location of the MRI scanning center.

Participants underwent resting-state fMRI (rs-fMRI) scans, which measure brain activity by detecting changes in blood flow. The researchers specifically targeted the default mode network (DMN), a network of brain regions active during rest and involved in high-level cognitive functions such as social cognition and self-referential thought.

Using a technique called dynamic causal modeling (DCM), they analyzed the rs-fMRI data to estimate the effective connectivity between different regions within the DMN. This method goes beyond simple correlations to model the causal influence one brain region has over another, providing a detailed picture of neural connectivity.

The researchers then used these connectivity estimates to train a machine learning model. This model aimed to distinguish between individuals who would go on to develop dementia and those who would not. The training process involved a rigorous cross-validation technique to ensure the models reliability and to prevent overfitting. Additionally, a prognostic model was developed to predict the time until dementia diagnosis, using similar data and validation techniques.

The predictive model achieved an area under the curve (AUC) of 0.824, indicating excellent performance in distinguishing between future dementia cases and controls. This level of accuracy is significantly higher than traditional diagnostic methods, which often struggle to detect early-stage dementia.

The model identified 15 key connectivity parameters within the DMN that differed significantly between future dementia cases and controls. Among these, the most notable changes included increased inhibition from the ventromedial prefrontal cortex (vmPFC) to the left parahippocampal formation (lPHF) and from the left intraparietal cortex (lIPC) to the lPHF, as well as attenuated inhibition from the right parahippocampal formation (rPHF) to the dorsomedial prefrontal cortex (dmPFC).

In addition to its diagnostic capabilities, the study also developed a prognostic model to predict the time until dementia diagnosis. This model showed a strong correlation (Spearmans = 0.53) between predicted and actual times until diagnosis, indicating its potential to provide valuable timelines for disease progression. The predictive power of these connectivity patterns suggests that changes in the DMN can serve as early biomarkers for dementia, offering a window into the disease process years before clinical symptoms appear.

Furthermore, the study explored the relationship between DMN connectivity changes and various risk factors for dementia. They found a significant association between social isolation and DMN dysconnectivity, suggesting that social isolation might exacerbate the neural changes associated with dementia. This finding highlights the importance of considering environmental and lifestyle factors in dementia risk and opens up potential avenues for intervention.

Using these analysis techniques with large datasets we can identify those at high dementia risk, and also learn which environmental risk factors pushed these people into a high-risk zone, said co-author Samuel Ereira. Enormous potential exists to apply these methods to different brain networks and populations, to help us better understand the interplays between environment, neurobiology and illness, both in dementia and possibly other neurodegenerative diseases. fMRI is a non-invasive medical imaging tool, and it takes about 6 minutes to collect the necessary data on an MRI scanner, so it could be integrated into existing diagnostic pathways, particularly where MRI is already used.

Despite the promising results, there are some caveats to consider. One limitation of the study is the use of data from the UK Biobank, which may not be fully representative of the general population. Participants in this cohort tend to be healthier and less socio-economically deprived. Future research should validate these findings in more diverse and representative samples.

One in three people with dementia never receive a formal diagnosis, so theres an urgent need to improve the way people with the condition are diagnosed. This will be even more important as dementia becomes a treatable condition, Julia Dudley, the head of Strategic Research Programmes at Alzheimers Research UK, told the Science Media Centre.

This study provides intriguing insights into early signs that someone might be at greater risk of developing dementia. While this technique will need to be validated in further studies, if it is, it could be a promising addition to the toolkit of methods to detect the diseases that cause dementia as early as possible. An earlier and accurate diagnosis is key to unlocking personalised care and support, and, soon, to accessing first-of-a-kind treatments that are on the horizon.

Eugene Duff, an advanced research fellow at the UK Dementia Research Institute at Imperial College London, added: This work shows how advanced analysis of brain activity measured using MRI can predict future dementia diagnosis. Early diagnosis of dementia is valuable for many reasons, particularly as improved pharmaceutical treatments become available.

Brain activity measures may be complementary to cognitive, blood and other markers for identifying those at risk for dementia. The brain modelling approach they use has the benefit of potentially clarifying the brain processes affected in the early stages of disease. However, the study cohort of diagnosed patients was relatively small (103 cases). Further validation and head-to-head comparisons of predictive markers is needed.

The study, Early detection of dementia with default-mode network effective connectivity, was authored by Sam Ereira, Sheena Waters, Adeel Razi, and Charles R. Marshall.

The rest is here:
First-of-its-kind test uses machine learning to predict dementia up to 9 years in advance - PsyPost

World Health Organization. Children: Reducing Mortality (World Health Organization, 2019).

Google Scholar

Rudan, I. et al. Global estimate of the incidence of clinical pneumonia among children under five years of age. Bull. World Health Organ. 82(12), 895903 (2004).

PubMed Google Scholar

Goodarzi, E. et al. Epidemiology of mortality induced by acute respiratory infections in infants and children under the age of 5 years and its relationship with the Human Development Index in Asia: An updated ecological study. J. Public Health 29(5), 10471054 (2021).

Article Google Scholar

Organization, W. H. World Report on Ageing and Health (World Health Organization, 2015).

Google Scholar

Anjum, M. U., Riaz, H. & Tayyab, H. M. Acute respiratory tract infections (Aris);: Clinico-epidemiolocal profile in children of less than five years of age. Prof. Med. J. 24(02), 322325 (2017).

Google Scholar

Ujunwa, F. & Ezeonu, C. Risk factors for acute respiratory tract infections in under-five children in enugu Southeast Nigeria. Ann. Med. Health Sci. Res. 4(1), 9599 (2014).

Article PubMed PubMed Central Google Scholar

Sultana, M. et al. Prevalence, determinants and health care-seeking behavior of childhood acute respiratory tract infections in Bangladesh. PloS one 14(1), e0210433 (2019).

Article CAS PubMed PubMed Central Google Scholar

Kjrgaard, J. et al. Diagnosis and treatment of acute respiratory illness in children under five in primary care in low-, middle-, and high-income countries: A descriptive FRESH AIR study. PLoS One 14(11), e0221389 (2019).

Article PubMed PubMed Central Google Scholar

Banda, B. et al. Risk factors associated with acute respiratory infections among under-five children admitted to Arthurs Children Hospital, Ndola, Zambia. Asian Pac. J. Health Sci. 3(3), 153159 (2016).

Article Google Scholar

Harerimana, J.-M. et al. Social, economic and environmental risk factors for acute lower respiratory infections among children under five years of age in Rwanda. Arch. Public Health 74(1), 17 (2016).

Article Google Scholar

Landrigan, P. J. et al. The Lancet Commission on pollution and health. Lancet 391(10119), 462512 (2018).

Article PubMed Google Scholar

Lelieveld, J. et al. Loss of life expectancy from air pollution compared to other risk factors: A worldwide perspective. Cardiovasc. Res. 116(11), 19101917 (2020).

Article CAS PubMed PubMed Central Google Scholar

Mirabelli, M. C., Ebelt, S. & Damon, S. A. Air quality index and air quality awareness among adults in the United States. Environ. Res. 183, 109185 (2020).

Article CAS PubMed PubMed Central Google Scholar

Fleming, S. et al. Normal ranges of heart rate and respiratory rate in children from birth to 18 years of age: A systematic review of observational studies. Lancet 377(9770), 10111018 (2011).

Article PubMed PubMed Central Google Scholar

Gasana, J. et al. Motor vehicle air pollution and asthma in children: A meta-analysis. Environ. Res. 117, 3645 (2012).

Article CAS PubMed Google Scholar

Osborne, S. et al. Air quality around schools: Part II-mapping PM2.5 concentrations and inequality analysis. Environ. Res. 197, 111038 (2021).

Article CAS PubMed Google Scholar

Vong, C.-M. et al. Imbalanced learning for air pollution by meta-cognitive online sequential extreme learning machine. Cognit. Comput. 7, 381391 (2015).

Article Google Scholar

Ginantra, N., Indradewi, I. & Hartono E. Machine learning approach for acute respiratory infections (ISPA) prediction: Case study indonesia. in Journal of Physics: Conference series. (IOP Publishing, 2020).

Ku, Y. et al. Machine learning models for predicting the occurrence of respiratory diseases using climatic and air-pollution factors. Clin. Exp. Otorhinolaryngol. 15(2), 168 (2022).

Article CAS PubMed PubMed Central Google Scholar

Ravindra, K. et al. Application of machine learning approaches to predict the impact of ambient air pollution on outpatient visits for acute respiratory infections. Sci. Total Environ. 858, 159509 (2023).

Article CAS PubMed Google Scholar

Aliaga, A. & Ren, R. The Optimal Sample Sizes for Two-Stage Cluster Sampling in Demographic and Health Surveys (ORC Macro, 2006).

Google Scholar

Hammer, M. S. et al. Global estimates and long-term trends of fine particulate matter concentrations (19982018). Environ. Sci. Technol. 54(13), 78797890 (2020).

Article ADS CAS PubMed Google Scholar

Croft, T. N. et al. Guide to DHS Statistics Vol. 645 (Rockville, ICF, 2018).

Google Scholar

Organization, W.H., Global influenza strategy 20192030. (2019).

Kjrgaard, J. et al. Correction: Diagnosis and treatment of acute respiratory illness in children under five in primary care in low-, middle-, and high-income countries: A descriptive FRESH AIR study. Plos one 15(2), e0229680 (2020).

Article PubMed PubMed Central Google Scholar

Fetene, M. T., Fenta, H. M. & Tesfaw, L. M. Spatial heterogeneities in acute lower respiratory infections prevalence and determinants across Ethiopian administrative zones. J. Big Data 9(1), 116 (2022).

Article Google Scholar

Yu, H.-F., Huang, F.-L. & Lin, C.-J. Dual coordinate descent methods for logistic regression and maximum entropy models. Mach. Learn. 85(12), 4175 (2011).

Article MathSciNet Google Scholar

Arthur, E. H. & Robert, W. K. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12(1), 5567 (1970).

Article Google Scholar

Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B (Methodol.) 58(1), 267288 (1996).

Article MathSciNet Google Scholar

Zou, H. & Hastie, T. Addendum: Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 67(5), 768768 (2005).

Article MathSciNet Google Scholar

Gron, A. Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems (OReilly Media, 2019).

Google Scholar

James, G. et al. An Introduction to Statistical Learning Vol. 112 (Springer, 2013).

Book Google Scholar

Patrick, E. A. & Fischer, F. P. III. A generalized k-nearest neighbor rule. Inform. Control 16(2), 128152 (1970).

Article MathSciNet Google Scholar

McCallum, A. & Nigam K. A comparison of event models for naive bayes text classification. In AAAI-98 workshop on learning for text categorization. (Madison, 1998).

Zhang, D. Bayesian classification. In Fundamentals of Image Data Mining 161178 (Springer, 2019).

Chapter Google Scholar

Chen, T. & Guestrin, C. Xgboost: A scalable tree boosting system. In Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, NY, USA, 2016), KDD 16, ACM. (2016).

Chen, T. & Guestrin C. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (2016).

Hecht-Nielsen, R. Theory of the backpropagation neural network. In Neural networks for perception 6593 (Elsevier, 1992).

Chapter Google Scholar

Abdelhafiz, D. et al. Deep convolutional neural networks for mammography: Advances, challenges and applications. BMC Bioinform. 20(11), 120 (2019).

Google Scholar

Hoerl, A. E. & Kennard, R. W. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12(1), 5567 (1970).

Article Google Scholar

Molina, M. & Garip, F. Machine learning for sociology. Ann. Rev. Sociol. 45, 2745 (2019).

Article Google Scholar

Marsland, S. Machine Learning: An Algorithmic Perspective (CRC Press, 2015).

Google Scholar

Zou, H. & Hastie, T. Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 67(2), 301320 (2005).

Article MathSciNet Google Scholar

Yuan, G.-X., Ho, C.-H. & Lin, C.-J. An improved glmnet for l1-regularized logistic regression. J. Mach. Learn. Res. 13(1), 19992030 (2012).

MathSciNet Google Scholar

Breiman, L. Random forests. Mach. Learn. 45(1), 532 (2001).

Article Google Scholar

Genuer, R., Poggi, J.-M. & Tuleau-Malot, C. Variable selection using random forests. Pattern Recognit. Lett. 31(14), 22252236 (2010).

Article ADS Google Scholar

Janitza, S., Tutz, G. & Boulesteix, A.-L. Random forest for ordinal responses: Prediction and variable selection. Comput. Stat. Data Anal. 96, 5773 (2016).

Article MathSciNet Google Scholar

Genuer, R., Poggi, J.-M. & Tuleau-Malot, C. VSURF: An R package for variable selection using random forests. R J. 7(2), 1933 (2015).

Article Google Scholar

Pal, M. Random forest classifier for remote sensing classification. Int. J. Remote Sens. 26(1), 217222 (2005).

Article Google Scholar

Rodriguez-Galiano, V. F. et al. An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS J. Photogramm. Remote Sens. 67, 93104 (2012).

Article ADS Google Scholar

Liaw, A. & Wiener, M. Classification and regression by randomForest. R news 2(3), 1822 (2002).

Google Scholar

Breiman, L. Random forests. Mach. Learn. 45, 532 (2001).

Article Google Scholar

Quinlau, R. Induction of decision trees. Mach. Learn. 1(1), S1S106 (1986).

See the original post here:
Factors of acute respiratory infection among under-five children across sub-Saharan African countries using machine ... - Nature.com

In this section, we discuss the outcomes produced by different machine learning models, aiming to compare and determine the most effective model for predicting cerebral aneurysm rupture based on 35 morphological and 3 clinical inputs. The evaluation criteria include accuracy for the train and test datasets, recall, precision, and accuracy for the test dataset and the receiver characteristic operation (ROC) curve. Following these evaluations for each model, we discuss the most significant features identified by the models. We aim to shed light on the correlation between each parameter and the rupture status of cerebral aneurysms. This analysis provides a comprehensive understanding of the influential factors contributing to the accurate prediction of aneurysm rupture.

The main metric for evaluating model performance and enabling comparisons between different models is accuracy, which is measured on both the train and test datasets. Accuracy is defined as the ratio of correctly predicted cases to all predicted cases. It is important to note that while high accuracy is desirable, achieving 100% accuracy is not optimal, as it may indicate overfitting and a lack of generalization to unseen data. Ideally, the train and test datasets should have similar accuracy, with a recommended maximum difference of 10%. In Fig.5, we present the accuracy results for all models. It is evident that all models can achieve an accuracy exceeding 0.70. XGB demonstrates the highest accuracy at 0.91, while KNN exhibits the lowest accuracy at 0.74. Assessing the generalizability of the models to new data, both MLP and SVM demonstrated superior performance, achieving an accuracy of 0.82 for the test dataset. This indicates that MLP and SVM outperform the other models in terms of predictive accuracy for unseen data.

Accuracy of train and test datasets.

In addition to accuracy, we included precision and recall as important metrics to comprehensively evaluate model performance. We made this decision due to the sensitivity of the medical data under consideration, emphasizing the importance of timely disease recognition. In simple terms, recall measures the models ability to correctly identify the presence of a disease. Recall is defined as the ratio of true positive predictions to the total number of actual positive cases. Similarly, precision reflects the models ability to accurately predict positive occurrences. Precision is defined as the ratio of true positive predictions to the total number of predicted positive cases.

In the medical context, recall holds particular significance, but accuracy and precision should not be overlooked, as they collectively contribute to overall model efficacy. Figure6 presents the evaluation of all three metrics (accuracy, precision, and recall) for the test dataset, with a specific focus on the ruptured class, representing the occurrence scenario in our study. SVM and MLP are the top-performing models once again. The results show that SVM and MLP have high recall rates of 0.92 and 0.90, respectively, in predicting the occurrence of cerebral aneurysm rupture. SVM also has an accuracy and precision of 0.82, whereas MLP has a precision of 0.83 and an accuracy of 0.82. In contrast, RF performed relatively poorly in all three criteria. However, it is noteworthy that even for RF, all performance metrics for the test dataset exceeded 0.75, indicating a high level of predictive capability.

Accuracy, precision, and recall for the test dataset.

Another metric used for evaluation is the ROC curve, which illustrates the true positive rate versus the false positive rate. Linear behavior, where the true and false positive rates are equal, represents a random classifier. As the model improves, the curve shifts toward the upper-left point. An ideal model would have a true positive rate of 1 and a false positive rate of 0. The area under the curve (AUC) is a representative measure of the models performance, with an AUC of 0.5 indicating a random classifier and an AUC of 1 indicating an ideal classifier. Figure7 presents the behavior of the ROC curve for each model, along with the corresponding AUC. Based on these criteria, SVM and MLP are the top-performing models engaged in close competition. Their ROC curves exhibit a favorable trajectory, and their AUC values affirm their strong performance. Conversely, RF demonstrates a comparatively poorer performance than the other models. In summary, all models demonstrate highly acceptable performance and scores. Optimizing these models to improve their reliability and effectiveness in predicting cerebral aneurysm rupture represents a valuable endeavor.

Receiver operating characteristic (ROC) curve for all models.

Given that each machine learning model employs a unique set of algorithms and mathematical relations, a difference in the weight assigned to each parameter for the final classification decision is expected. Figure8 displays the weights of each parameter for the two top-performing models in this study. The SVM model identifies the first five dominant features as EI (Ellipticity Index), SR (Size Ratio), I (Irregularity), UI (Undulation Index), and IR (Ideal Roundness), a new parameter introduced in this study. The MLP model, on the other hand, prioritizes EI, I, Location, NA (Neck Area), and IR, with IR once again demonstrating a significant impact.

Dominant Features for the two top-performing models.

Other novel parameters introduced in this study include NC, IS, ON, IRR, COD, ISR, and IOR, which occupy positions 6, 9, 13, 19, 27, 30, and 36, respectively, for SVM. For the MLP model, the order of these new parameters is IR (5), NC (7), ON (18), IS (24), ISR (27), COD (32), IOR (34), and IRR (38). Notably, some parameters for the MLP model exhibit negative values, indicating an inverse effect on the models prediction and an inverse correlation with the output. It is important to acknowledge that this pattern may vary depending on the architecture used for the MLP model.

One potential question that may arise in this study is whether bifurcation aneurysms are more prone to rupture than lateral aneurysms, based on physicians experience. However, our study does not show a significant contribution from this factor. This discrepancy does not imply that the bifurcation and lateral status are insignificant. Instead, it highlights that when other features are considered alongside this parameter, there is a stronger correlation among other parameters than with this specific one. Essentially, by expanding our input variables and making decisions based on more comprehensive information, we uncover the significance of parameters that may not have been previously considered. Thanks to modern machine learning models, it is now possible to compare several parameters simultaneously and discern the contribution of each in relation to others. This approach allows for more reliable decision-making by considering a broader set of factors and better understanding the complex interplay of variables that contribute to the prediction of cerebral aneurysm rupture.

We now undertake a brief comparison between prior research and the current study, focusing specifically on the testing datasets used across all studies. To facilitate this analysis, we refer to which presents the outcomes of six comparable studies alongside those of our own investigation. As previously indicated, we endeavored to incorporate a comprehensive array of morphological parameters to ensure the robustness of our findings.

As the scope of parameters considered expands, shifts in the relative importance assigned to each parameter are anticipated. Furthermore, increasing the size of the dataset can enhance the reliability of the results. Among the parameters of significance, the size ratio emerges as a recurrent focal point, underscoring its inherent importance in assessing the risk of rupture. Once more, we underscore the significance of the recall score, given the sensitivity inherent in medical data. It is noteworthy that our study achieves an outstanding recall score, a metric that is unfortunately absent from prior studies, thus limiting direct comparison.

Table 3, which presents the outcomes of six comparable studies alongside those of our own investigation. As previously indicated, we endeavored to incorporate a comprehensive array of morphological parameters to ensure the robustness of our findings.

As the scope of parameters considered expands, shifts in the relative importance assigned to each parameter are anticipated. Furthermore, increasing the size of the dataset can enhance the reliability of the results. Among the parameters of significance, the size ratio emerges as a recurrent focal point, underscoring its inherent importance in assessing the risk of rupture. Once more, we underscore the significance of the recall score, given the sensitivity inherent in medical data. It is noteworthy that our study achieves an outstanding recall score, a metric that is unfortunately absent from prior studies, thus limiting direct comparison.

Excerpt from:
A comprehensive investigation of morphological features responsible for cerebral aneurysm rupture using machine ... - Nature.com

In the last few years, as the labor market tightened, companies increasingly turned inward, searching within their ranks for hidden gems of talent.

The strategy, although well-intentioned, often fell short of its potential. HR managers and department heads rolled out skills assessments, performance evaluations and career development programs in a bid to squeeze out more productivity and promote from within.

A knock-on effect was, in the best of cases, a more spirited corporate culture and a boost in loyalty and retention, as employees felt seen and valued.

However, lets be honest: Little headway was made. Rather than identifying internal prospects for promotion, these approaches were best suited to measuring what employees did well in the jobs they were in.

On top of that, these efforts to advance worker mobility were costly, time-consuming and challenging to scale throughout the organization. Frustrated leaders often resorted to a default tactic: hiring externally. Place job ads and watch the resumes roll in.

The grow-your-own push seemed to be fading. Data showed that worker mobility has been waning for years, partly because companies fail to benchmark metrics that produce better outcomes.

But theres a more promising approach to finding these hidden gems: leveraging technologyspecifically the hot new capabilities unlocked by artificial intelligence, machine learning and large language models.

This tech combination could be a perfect fit for companiesespecially medium-sized ones seeking to boost their workforces productivity. Whats key is that the AI combo can process reams of valuable information produced by workers in a variety of interactions that we tend to overlook: presentations, video conferences, reports and emails.

Leaders can discover talents and capabilities obscured by what a worker is currently being asked to do. Data is produced in real time, continuously updated and can be analyzed on the spot.

With AI engines capable of crunching that large volume of data, comparisons among employees become easier for managers. Some workers may need more training. Others are ripe for promotion. As a workforce development tool, it is very empowering for employees.

Here are examples of what AI can uncover on the job:

In addition to analyzing hard skills, AI can also hone in on soft skills, which are in high demand. This technology can scrutinize and benchmark problem-solving, collaboration, critical thinking and communication skills. Recent developments in LLMs, particularly with omnichannel models, show new applications in scaling coaching for employees in these essential skills. By leveraging personalized engagement and AI-driven insights, organizations can provide tailored coaching and development opportunities that were previously impractical at scale.

Because AI, machine learning and large language models can review most work done on the job, employees true skill sets are uncovered. These are the hidden gems that can bring overlooked value to companies. It might turn out that a reticent programmer has the gift of persuasion. An entry-level worker may possess gifted math skills. And so on.

Companies can also discover new information in their industry. For example, AI might reveal an uptick in the demand for prompt engineers in job ads or indicate a decline in capital expenditures in quarterly reports, potentially signaling a recession.

A challenge for companies considering using this AI combo is how to implement it. Up-front effort is required. It works like this: An organization starts with a pre-trained model with generic data and then spends four to six weeks calibrating it so the information captured is specific to that entity. Once the knowledge engine starts learning the companys data, leaders can expect a high level of accuracy in picking up the presence and proficiency levels in the skills of each employee.

A misunderstood part of AI that I consider good news is the fact that it will end up helping, not hurting, workers. After all, it can pinpoint hard and soft skills, leading to their development and promotion within a company.

In that way, AI benefits both employer and employee. As I like to say: The employer is sitting on the best evidence of what an employee is capable of.

See the original post:
From overlooked to overachiever: Using AI to drive worker mobility - Human Resource Executive

Artificial intelligence (AI) and big data share a symbiotic relationship. One of the primary challenges in implementing big data governance is ensuring data awareness and understanding across the organization. Data governance initiatives often fail when stakeholders are not aware of the importance of data governance or lack the knowledge to implement it effectively. Automation plays a pivotal role in modern data governance, significantly enhancing cost-effectiveness. By automating processes, organizations can streamline governance efforts and allocate resources more efficiently. Machine learning further advances these efforts by accelerating metadata collection and improving categorization accuracy, highlighting its critical role in optimizing data governance practices.

Also Read: How AI Is Transforming Big Data?

AI relies heavily on vast datasets for enhancing model training, enabling more precise predictions. Concurrently, big data leverages AI tools to bolster its analytical capabilities. AIs effectiveness hinges on data availability. Without sufficient data, AI functions merely as a theoretical concept. This interplay becomes increasingly crucial as data accessibility expands, facilitating machine learning and iterative processes that drive improved accuracy and operational efficiency autonomously.

A recent report from Drexel Universitys LeBow Center for Business Analytics reveals that 77% of data and analytics professionals prioritize data-driven decision-making within their data programs. However, less than half of survey respondents express high or very high levels of trust in their data. This lack of confidence is largely attributed to poor data quality, which not only obstructs the success of data programs but also undermines data integration efforts and compromises data integrity, presenting significant challenges for big data governance.

Big data governance refers to the management framework implemented within an organization to ensure the proper handling, integrity, usability, and security of big data sets. This framework includes policies, procedures, and standards that govern data access, data quality, compliance with data-related regulations, and data protection.

The AIGA AI Governance and Auditing, led by the University of Turku in Finland, collaborates with academic and industry partners, akin to Google, to offer guidance on the responsible development and deployment of AI.

The AIGA AI Governance Framework serves as a practical manual for organizations aiming to implement ethical and responsible AI systems. Its primary objectives include:

At the core of the discussion, there is an overlaying of ethical AI, data policies, and current data governance. Besides mere algorithmic technical acquaintance, ethical AI encompasses efforts to imbue fairness, transparency, and accountability in the conduction and implementation of AI. Conversely, data governance avails the scaffold for dealing responsibly in the management, protection, and usage of data assets.

Fairness ensures that AI systems do not reflect bias or result in discrimination. This is the principle that will assure stakeholders about the operations of the AI algorithms. Accountability creates liability for developers and operators in AI systems decisions and results. These principles make AI applications greater in lowering ethical risks and increasing trust from users and society.

It addresses the interplay between a concern for ethics in AI and data governance by identifying a series of challenges and opportunities. It emphasizes the requirement to establish a basis for a culture of conscientiousness and responsibility concerning ethical AI. Companies engaging with such matters of ethics will be able to maximize AI transformation and guard individual rights and aspirations.

Also Read: The Rise of AI in Data Collection: Implications and Opportunities for Businesses

Organizations are nowadays using AI more and more to strengthen their data analytics ability and maintain an advantage in the market. When AI is combined with data governance rules, companies can maximize the ROI by measuring ineffective practices and boosting successful strategies:.

Their use is different in different organizational departments for varied data sources that are used in their respective industriesfor example, sales departments that analyze consumer trends. This use has been quite populous with the use of predictive analytics, which increases operational efficiency.

The manufacturing departments in organizations base their investment in AI on analytics to meet their industry needs, targeting the betterment of productive processes, when hardly anything else is. Root causes for quality issues are identified, and then management is equipped to make decisions, and just maybe, those issues are prevented through predictive maintenance strategies.

AI is important for the detection of anomalies and cybersecurity. Machine learning makes AI perform the detection and response of threats timely, especially those concerning data breaches. This proactive approach ensures data integrity and compliance through continuous monitoring and rapid response capabilities.

The democratization of data governance is greatly increased, with AI providing secure data access and not intercepted by cybercriminalsmeaning sophisticated tactics such as Man-In-The-Middle or ransomware. By automating privacy, compliance, and security measures, AI acts as a 24/7 safeguard against cyber threats, thus enhancing data protection.

Moreover, AI also enables the automated discovery of processes, while being able to analyze behavioral data and develop digital records with ease, hence effectively streamlining processes for data management.

AI systems heavily rely on extensive datasets for learning and operational tasks. However, ensuring data accuracy and fairness poses challenges when dealing with incomplete, outdated, inconsistent, or biased data. Organizations must establish stringent data standards, validate sources rigorously, and continually monitor and audit data quality throughout the AI lifecycle to mitigate these issues effectively.

The processing of sensitive data by AI systems, such as health records or financial information, exposes organizations to significant risks like breaches and misuse. Securing data through robust encryption, access controls, and anonymization techniques is crucial. Moreover, compliance with data protection regulations and ethical principles is essential to safeguard against unauthorized access and ensure data privacy.

Integrating diverse data types (structured, unstructured, streaming) from various sources (internal, external, cloud-based) presents significant challenges in data consistency and compatibility. Adopting standardized data models, schemas, and formats, along with leveraging integration tools and platforms, helps organizations achieve seamless data exchange and interoperability across systems.

Effective utilization of AI requires a workforce equipped with strong data literacy skills and a supportive data-driven organizational culture. Enhancing data literacy involves enabling employees to understand, analyze, and effectively utilize data. Fostering a data-driven culture encourages informed decision-making and innovation. Organizations should invest in comprehensive data education, training, and collaborative initiatives to build trust and maximize the adoption of AI technologies among stakeholders.

Improve Data Quality

Data quality is fundamental to any effective data strategy. AI enhances data quality by automating error detection and correction within datasets, thereby reducing inconsistencies and inaccuracies. AI algorithms also standardize data structures, facilitating easier comparison and analysis while uncovering hidden trends and patterns.

Automate Data Compliance

In todays landscape of escalating cyber threats, maintaining data compliance is crucial. AI plays a pivotal role in ensuring continuous compliance by monitoring data flows in real-time. It detects anomalies, unauthorized access attempts, and potential violations of data regulations, triggering alerts and recommendations for corrective actions. Additionally, AI automates the classification and labeling of sensitive data and generates compliance reports, thereby reducing administrative burdens.

Strengthen Data Security

AI enhances data security by proactively analyzing data access patterns to detect suspicious activities such as intrusions or unauthorized access attempts. Leveraging machine-learning-based malware detection systems, AI identifies and mitigates both known and unknown threats by analyzing behavioral patterns. Moreover, AI automates security patch management and monitors adherence to security policies, bolstering overall cybersecurity measures.

Democratize Data

Central to effective data strategy is fostering a data-driven culture within organizations. AI facilitates this by simplifying data access and analysis. AI-powered search engines swiftly extract relevant information from extensive datasets, enabling employees to efficiently retrieve necessary data. Furthermore, AI automates data aggregation and presentation through interactive dashboards, enhancing data accessibility and facilitating seamless information sharing across teams.

The volume of data is growing exponentially, projected to reach 180 zettabytes by 2025. To navigate this vast landscape effectively, artificial intelligence (AI) plays a pivotal role in extracting actionable insights.

AI utilizes machine learning and deep learning tools that leverage big data to learn and evolve over time. These algorithms iteratively refine models to optimize solutions and generate valuable insights for informed decision-making.

Traditionally, data analysis provided a snapshot of current conditionsThis is what has occurred. With AI and machine learning, predictive capabilities extend to forecasting future scenarios and prescribing optimal strategies for sustainable outcomes.

Moreover, AI has revolutionized data analysis by automating complex tasks that were once labor-intensive. Previously, analysts relied on SQL queries and manual statistical modeling, which could take weeks to yield insights. Today, AI-driven analytics processes data swiftly, reducing analysis times to just one or two days.

This section illustrates how AI enhances data insights by harnessing advanced technologies to derive deeper, faster, and more accurate business intelligence from expansive datasets.

The future of data governance is intricately intertwined with the evolution of Artificial Intelligence (AI). In response to escalating data complexity and volume, AI is poised to become an indispensable tool, elevating data governance to a more sophisticated, agile, and proactive level.

AIs capacity for learning, adaptation, and prediction will revolutionize compliance, security processes, and policy adjustments in real time, introducing a forward-thinking approach to governance. By leveraging predictive capabilities, organizations can anticipate challenges and capitalize on opportunities, ensuring that data remains a secure and reliable asset for informed decision-making.

Looking ahead, the integration of AI into data governance transcends mere enhancement; it is essential for unlocking the full potential of data while upholding compliance and strategic integrity. This transformation towards AI-enhanced governance represents a crucial adaptation to a digital landscape where data plays a pivotal role in driving business operations forward.

[To share your insights with us as part of editorial or sponsored content, please write topsen@itechseries.com]

See the original post here:
AI and Big Data Governance: Challenges and Top Benefits - AiThority