machine_learn | Unsorted

Telegram-канал machine_learn - Machine learning books and papers

23990

Admin: @Raminmousa1 ID: @Machine_learn link: https://t.me/Machine_learn

Subscribe to a channel

Machine learning books and papers

Data Structures and Information Retrieval in Python

📓 link

@Machine_learn

Читать полностью…

Machine learning books and papers

با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.

Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)

Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.

journal: https://www.sciencedirect.com/journal/expert-systems-with-applications

if:7.5

هزینه مشارکت برای نفر سوم ۲۰ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.

@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Images


Publication date:
IEEE Transactions on Geoscience and Remote Sensing 2024

Topic: Object detection

Paper
: https://arxiv.org/pdf/2409.19648v1.pdf

GitHub: https://github.com/wokaikaixinxin/OrientedFormer

Description:

In this paper, we propose an end-to-end transformer-based oriented object detector, consisting of three dedicated modules to address these issues. First, Gaussian positional encoding is proposed to encode the angle, position, and size of oriented boxes using Gaussian distributions. Second, Wasserstein self-attention is proposed to introduce geometric relations and facilitate interaction between content and positional queries by utilizing Gaussian Wasserstein distance scores. Third, oriented cross-attention is proposed to align values and positional queries by rotating sampling points around the positional query according to their angles.

@Machine_learn

Читать полностью…

Machine learning books and papers

Computational Geometry

📕 Book


@Machine_learn

Читать полностью…

Machine learning books and papers

Welcome to Ollama's Prompt Engineering Interactive Tutorial

🔗 Github

/channel/deep_learning_proj

Читать полностью…

Machine learning books and papers

یک هفته تا سابمیت نهایی این مقاله باقی مونده...!

Читать полностью…

Machine learning books and papers

⭐️ Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement

RAG-Diffusion now supports FLUX.1 Redux!

🔥 Ready to take control? Customize your region-based images with our training-free solution and achieve powerful, precise results!

🔗 Code: https://github.com/NJU-PCALab/RAG-Diffusion

@Machine_learn

Читать полностью…

Machine learning books and papers

LLM-based agents for Software Engineering
"Large Language Model-Based Agents for Software Engineering: A Survey".

https://github.com/FudanSELab/Agent4SE-Paper-List.

/channel/deep_learning_proj

Читать полностью…

Machine learning books and papers

با عرض سلام نفر سوم و چهارم براي مقاله زير رو خالي داريم.

Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)

Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.

journal: https://www.sciencedirect.com/journal/expert-systems-with-applications

if:7.5

هزینه نفرات به ترتیب ۲۰ و ۱۵ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.

@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

📚 Machine learning mastery

🔗 Github


@Machine_learn

Читать полностью…

Machine learning books and papers

📃Deep learning approaches for non-coding genetic variant effect prediction: current progress and future prospects

📎 Study the paper

@Machine_learn

Читать полностью…

Machine learning books and papers

Gaussian Processes for Machine Learning

📚 link

@Machine_learn

Читать полностью…

Machine learning books and papers

⚡️ Biggest open text dataset release of the year: SmolTalk is a 1M sample big synthetic dataset that was used to train SmolLM v2.

TL;DR;
🧩 New datasets: Smol-Magpie-Ultra (400K) for instruction tuning; Smol-contraints (36K) for precise output; Smol-rewrite (50K) & Smol-summarize (100K) for rewriting and summarization.
🤝 Public Dataset Integrations: OpenHermes2.5 (100K), MetaMathQA & NuminaMath-CoT, Self-Oss-Starcoder2-Instruct, LongAlign & SystemChats2.0
🥇 Outperforms the new Orca-AgenInstruct 1M when trained with 1.7B and 7B models
🏆 Outperform models trained on OpenHermes and Magpie Pro on IFEval and MT-Bench
distilabel to generate all new synthetic datasets
🤗 Released under Apache 2.0 on huggingface

Apache 2.0

Synthetic generation pipelines and training code released.

Dataset: https://huggingface.co/datasets/HuggingFaceTB/smoltalk
Generation Code: https://github.com/huggingface/smollm
Training Code: https://github.com/huggingface/alignment-handbook/tree/main/recipes/smollm2

@Machine_learn

Читать полностью…

Machine learning books and papers

Title: Transformer and XGBoost for time-series forecasting of Bitcoin prices using high-dimensional features


ABSTRACT: Bitcoin price prediction based on price indicators has become a hot field of study. In this article, Bitcoin price prediction is discussed based on hash rate features. For this purpose, a series of price indices were used in the beginning and the selection of features was done among 20 features. On the other hand, the selection of features was also done on the raw data of eight rates. This research used forecasting for one, seven, thirty and ninety days. In the classification based on raw features, the highest accuracy is 81%, and for a 90-day interval, on the other hand, the lowest RMSE value is 1.85, which is for a one-day interval. In the classification based on the features extracted from the indicators, the highest accuracy is 73% for the 90-day interval and the lowest RMSE is 1.58 for the 1-day interval.
نياز به co-author براي اين مقاله هستيم شرايط رو اگر كسي از دوستان داشت به بنده مراجعه كنن.
@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

📖 Penn State University's "Graph Theory"


📌 Lectures

@Machine_learn

Читать полностью…

Machine learning books and papers

🌟 OmniParser
🟡Arxiv
🖥Github


@Machine_learn

Читать полностью…

Machine learning books and papers

🌟 INTELLECT-1: Release of the first decentralized learning model.

PRIME Intellect has published INTELLECT-1 ( Instruct + Base ), the first 10 billion parameter language model collaboratively trained in 50 days by 30 participants worldwide.

PRIME Intellect used its own PRIME platform, designed to address the main problems of decentralized learning: network unreliability and dynamic management of computing nodes.

The platform utilized a network of 112 H100 GPUs across 3 continents and achieved a compute utilization rate of 96% under optimal conditions.

The training corpus consisted of 1 trillion public dataset tokens with the following percentage distribution: 55% fineweb-edu, 10% fineweb, 20% Stack V1, 10% dclm-baseline, 5% open-web-math.

▶️ Technical specifications:

🟢 Parameters: 10B;
🟢 Layers: 42;
🟢 Attention Heads: 32;
🟢 Hidden Size: 4096;
🟢 Context Length: 8192;
🟢 Vocabulary Size: 128256.

INTELLECT-1 achieved 37.5% accuracy on the MMLU test and 72.26% on HellaSwag, and outperformed several other open-source models on WinoGrande with a score of 65.82%.

While these figures lag slightly behind today's popular models, the results of the experiment are a critical step toward democratizing AI development and preventing the consolidation of AI capabilities within a few organizations.

▶️ GGUF quantized versions of INTELLECT-1_Instruct in 3-bit (5.46 GB) to 8-bit (10.9 GB) bit depths from the LM Studio community.

▶️ Example of inference on Transformers:

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

torch.set_default_device("cuda")
model = AutoModelForCausalLM.from_pretrained("PrimeIntellect/INTELLECT-1")
tokenizer = AutoTokenizer.from_pretrained("PrimeIntellect/INTELLECT-1")

input_text = "%prompt%"
input_ids = tokenizer.encode(input_text, return_tensors="pt")
output_ids = model.generate(input_ids, max_length=50, num_return_sequences=1)
output_text = tokenizer.decode(output_ids[0], skip_special_tokens=True)

print(output_text)


📌 Licensing: Apache 2.0 License.


🟡 Article
🟡 HF Model Kit
🟡 Set of GGUF versions
🟡 Technical report
🟡 Demo
🖥 GitHub

@Machine_learn

Читать полностью…

Machine learning books and papers

⚡️ MobileLLM


🟢MobileLLM-125M. 30 Layers, 9 Attention Heads, 3 KV Heads. 576 Token Dimension;

🟢MobileLLM-350M. 32 Layers, 15 Attention Heads, 5 KV Heads. 960 Token Dimension;

🟢MobileLLM-600M. 40 Layers, 18 Attention Heads, 6 KV Heads. 1152 Token Dimension;

🟢MobileLLM-1B. 54 Layers, 20 Attention Heads, 5 KV Heads. 1280 Token Dimension;


🟡Arxiv
🖥GitHub


@Machine_learn

Читать полностью…

Machine learning books and papers

یک هفته تا سابمیت نهایی این مقاله باقی مونده...!

Читать полностью…

Machine learning books and papers

Python for Everyone

🖥 book

@Machine_learn

Читать полностью…

Machine learning books and papers

با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.

Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)

Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.

journal: https://www.sciencedirect.com/journal/expert-systems-with-applications

if:7.5

هزینه مشارکت برای نفر سوم ۲۰ تومن می باشد. این هزینه صرف تسویه سرورها خواهد شد.

@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

Super beginner-friendly book on Linear Algebra

🔗 Book

@Machine_learn

Читать полностью…

Machine learning books and papers

فقط جايگاه ٣ باقي مونده...!

Читать полностью…

Machine learning books and papers

با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.

Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)

Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.

journal: https://www.sciencedirect.com/journal/expert-systems-with-applications

if:7.5

@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

📚 Deep Learning with Python Develop Deep Learning Models on Theano and TensorFLow Using Keras by Jason Brownlee

🔗 Book


@Machine_learn

Читать полностью…

Machine learning books and papers

با عرض سلام نفر سوم براي مقاله زير رو خالي داريم.

Title: Alzheimer’s disease (AD) classification
using swin transformer wavelet
and Improved Gray Wolf
Optimization (IGWO)

Abstract: Alzheimer’s disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer’s disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, our goal is to present ALzSwinTNet for Alzheimer’s classification based on FMRI images. The proposed approach uses wavelet fusion in the swin transformer network to extract features. The igwo and fox optimization approaches were used to find the hyperparameters of the model. ALzSwinTNet was able to achieve an accuracy of 0.98 in 4-class classification and 1 in 2-class classification.

journal: https://www.sciencedirect.com/journal/expert-systems-with-applications

if:7.5

@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

fmri alzheimer's disease classification
target journal:https://www.sciencedirect.com/journal/computerized-medical-imaging-and-graphics

نفر ٣ رو كم داريم.

نيازمند كسي هستيم كه بتونه هزينه سرور رو پرداخت كنه .

@Raminmousa
@Machine_learn
/channel/+SP9l58Ta_zZmYmY0

Читать полностью…

Machine learning books and papers

📖 General Relativity

📌 Book

@Machine_learn

Читать полностью…

Machine learning books and papers

ShowUI is a lightweight vision-language-action model for GUI agents.

🖥 Github: https://github.com/showlab/showui

📕 Paper: https://arxiv.org/abs/2411.17465v1

🌟 Dataset: https://huggingface.co/datasets/showlab/ShowUI-desktop-8K

@Machine_learn

Читать полностью…

Machine learning books and papers

O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?

🖥 Github: https://github.com/gair-nlp/o1-journey

📕 Paper: https://arxiv.org/abs/2411.16489v1

🌟 Dataset: https://paperswithcode.com/dataset/lima

💠@Machine_learn

Читать полностью…
Subscribe to a channel