Sep 23 14:51:10 devstack cinder-volume[76021]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 23 14:51:10 devstack cinder-volume[76021]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 23 14:51:10 devstack cinder-volume[76021]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 23 14:51:12 devstack cinder-volume[76021]: INFO dbcounter [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Registered counter for database cinder
Sep 23 14:51:12 devstack cinder-volume[76021]: DEBUG oslo_db.sqlalchemy.engines [None req-959763e2-3874-40e5-83a0-863ec614903b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:51:12 devstack cinder-volume[76021]: DEBUG dbcounter [-] [76021] Writer thread running {{(pid=76021) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 23 14:51:12 devstack cinder-volume[76021]: INFO cinder.rpc [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 14:51:12 devstack cinder-volume[76021]: INFO cinder.rpc [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 14:51:12 devstack cinder-volume[76021]: DEBUG oslo_db.sqlalchemy.engines [None req-959763e2-3874-40e5-83a0-863ec614903b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:51:12 devstack cinder-volume[76021]: INFO cinder.volume.manager [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Determined volume DB was empty at startup.
Sep 23 14:51:12 devstack cinder-volume[76021]: DEBUG cinder.volume.manager [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76021) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 23 14:51:12 devstack cinder-volume[76021]: INFO cinder.volume.manager [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 23 14:51:12 devstack cinder-volume[76021]: WARNING stevedore.named [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 14:51:12 devstack cinder-volume[76021]: WARNING castellan.key_manager [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 14:51:12 devstack cinder-volume[76021]: WARNING cinder.keymgr.conf_key_mgr [None req-959763e2-3874-40e5-83a0-863ec614903b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 14:51:12 devstack cinder-volume[76021]: DEBUG cinder.volume.drivers.lvm [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76021) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 23 14:51:12 devstack cinder-volume[76021]: DEBUG oslo_concurrency.processutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:13 devstack cinder-volume[76021]: DEBUG oslo_concurrency.processutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] CMD "cinder-rtstool verify" returned: 0 in 0.952s {{(pid=76021) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:13 devstack cinder-volume[76021]: DEBUG oslo_db.sqlalchemy.engines [None req-959763e2-3874-40e5-83a0-863ec614903b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:51:14 devstack cinder-volume[76021]: INFO cinder.rpc [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 23 14:51:14 devstack cinder-volume[76021]: INFO cinder.rpc [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 23 14:51:14 devstack cinder-volume[76021]: WARNING stevedore.named [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 14:51:14 devstack cinder-volume[76021]: WARNING castellan.key_manager [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 14:51:14 devstack cinder-volume[76021]: INFO cinder.volume.manager [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_db.sqlalchemy.engines [None req-959763e2-3874-40e5-83a0-863ec614903b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76021) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:51:14 devstack cinder-volume[76021]: INFO oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Starting 1 workers
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Started child 76145 {{(pid=76021) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Full set of CONF: {{(pid=76021) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] ******************************************************************************** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Configuration options gathered from: {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] ================================================================================ {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] allow_availability_zone_fallback = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] allow_compression_on_image_upload = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] allowed_direct_url_schemes     = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] api_rate_limit                 = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] auth_strategy                  = keystone {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] az_cache_duration              = 3600 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_availability_zone      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_host                   = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_name                   = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_stats_polling_interval = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backup_api_class               = cinder.backup.api.API {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backup_name_template           = backup-%s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backup_use_same_host           = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backup_use_temp_snapshot       = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] chap_password                  = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] chap_username                  =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_internal_tenant_project_id = f8c381caac75406f8ffb9690560f666e {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_internal_tenant_user_id = 2b15ab08858344a4bc10882cacdd5248 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cloned_volume_same_az          = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cluster                        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] compression_format             = gzip {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] compute_api_class              = cinder.compute.nova.API {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] config_dir                     = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] config_source                  = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] control_exchange               = openstack {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] debug                          = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] default_availability_zone      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76145]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] default_group_type             = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] default_volume_type            = lvmdriver-1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] driver_client_cert             = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] driver_client_cert_key         = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] driver_data_namespace          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] driver_ssl_cert_path           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] driver_ssl_cert_verify         = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] driver_use_ssl                 = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] enable_force_upload            = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] enable_new_services            = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] enable_unsupported_driver      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] enforce_multipath_for_image_xfer = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] filter_function                = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_api_insecure            = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_api_servers             = ['http://192.168.122.101/image'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_api_ssl_compression     = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_ca_certificates_file    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_catalog_info            = image:glance:publicURL {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_certfile                = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_keyfile                 = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_num_retries             = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance_request_timeout         = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] goodness_function              = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] graceful_shutdown_timeout      = 5 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] group_api_class                = cinder.group.api.API {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] host                           = devstack {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_compress_on_upload       = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_conversion_address_space_limit = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_conversion_cpu_limit     = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_conversion_disable       = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_upload_use_cinder_backend = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_upload_use_internal_tenant = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_volume_cache_enabled     = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_volume_cache_max_count   = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] image_volume_cache_max_size_gb = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] init_host_max_objects_retrieval = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] instance_format                = [instance: %(uuid)s]  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iscsi_iotype                   = fileio {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iscsi_target_flags             =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iscsi_write_cache              = on {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iser_helper                    = tgtadm {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iser_ip_address                = 192.168.122.101 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iser_port                      = 3260 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_color                      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_config_append              = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_dir                        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_file                       = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_options                    = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_rotate_interval            = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_rotate_interval_type       = days {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] log_rotation_type              = none {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] max_age                        = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] max_logfile_count              = 30 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] max_logfile_size_mb            = 200 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] max_over_subscription_ratio    = 20.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] message_reap_interval          = 86400 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] message_ttl                    = 2592000 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] migration_create_volume_timeout_secs = 300 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] monkey_patch                   = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] monkey_patch_modules           = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] my_ip                          = 192.168.122.101 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] no_snapshot_gb_quota           = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] num_iser_scan_tries            = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] num_shell_tries                = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] num_volume_device_scan_tries   = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] nvmeof_conn_info_version       = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] nvmet_ns_id                    = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] nvmet_port_id                  = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_max_limit                = 1000 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_volume_ext_list          = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_volume_listen_port       = 8776 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_volume_use_ssl           = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] osapi_volume_workers           = 2 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] per_volume_size_limit          = -1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] periodic_fuzzy_delay           = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] periodic_interval              = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] public_endpoint                = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] publish_errors                 = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_backup_gigabytes         = 1000 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_backups                  = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_gigabytes                = 1000 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_groups                   = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_snapshots                = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] quota_volumes                  = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] rate_limit_burst               = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] rate_limit_except_level        = CRITICAL {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] rate_limit_interval            = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] reinit_driver_count            = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] replication_device             = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] report_discard_supported       = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] report_interval                = 120 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] reservation_clean_interval     = 86400 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] reservation_expire             = 86400 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] reserved_image_namespaces      = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] reserved_percentage            = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] rpc_response_timeout           = 120 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] run_external_periodic_tasks    = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] scst_target_driver             = iscsi {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] scst_target_iqn_name           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_down_time              = 720 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] shell_completion               = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] snapshot_name_template         = snapshot-%s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] snapshot_same_host             = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] split_loggers                  = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] state_path                     = /opt/stack/data/cinder {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] storage_availability_zone      = nova {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] storage_protocol               = iSCSI {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] syslog_log_facility            = LOG_USER {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] target_helper                  = lioadm {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] target_ip_address              = 192.168.122.101 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] target_port                    = 3260 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] target_protocol                = iscsi {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] target_secondary_ip_addresses  = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] trace_flags                    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] transport_url                  = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] until_refresh                  = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_chap_auth                  = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_default_quota_class        = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_journal                    = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_json                       = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_multipath_for_image_xfer   = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_stderr                     = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] use_syslog                     = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] verify_glance_signatures       = enabled {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_api_class               = cinder.volume.api.API {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_backend_name            = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_clear                   = zero {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_clear_ionice            = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_clear_size              = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_copy_bps_limit          = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_dd_blocksize            = 1M {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_name_template           = volume-%s {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_service_inithost_offload = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volume_usage_audit_period      = month {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] watch_log_file                 = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] zoning_mode                    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_concurrency.disable_process_locking = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.admin_password = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.admin_token = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.admin_user  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_port   = 35357 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_protocol = https {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_section = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_type   = password {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_uri    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.auth_version = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.cache       = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.certfile    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.identity_uri = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.include_service_catalog = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.insecure    = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.interface   = public {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.keyfile     = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_password =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcache_username =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.region_name = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.service_token_roles_required = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.service_type = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.backend                  = dogpile.cache.null {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.backend_argument         = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.backend_expiration_time  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.config_prefix            = cache.oslo {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.dead_timeout             = 60.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.debug_cache_backend      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.enable_retry_client      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.enable_socket_keepalive  = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.enabled                  = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.enforce_fips_mode        = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.expiration_time          = 600 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.hashclient_retry_attempts = 2 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_dead_retry      = 300 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_password        = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_pool_maxsize    = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_sasl_enabled    = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.memcache_username        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.proxies                  = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_db                 = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_password           = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_server             = localhost:6379 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_socket_timeout     = 1.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.redis_username           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.retry_attempts           = 2 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.retry_delay              = 0.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.socket_keepalive_count   = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.socket_keepalive_idle    = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.socket_keepalive_interval = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.tls_allowed_ciphers      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.tls_cafile               = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.tls_certfile             = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.tls_enabled              = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cache.tls_keyfile              = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] coordination.backend_url       = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.asyncio_connection    = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.asyncio_slave_connection = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.backend               = sqlalchemy {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.connection            = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.connection_debug      = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.connection_parameters =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.connection_recycle_time = 3600 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.connection_trace      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.db_inc_retry_interval = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.db_max_retries        = 20 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.db_max_retry_interval = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.db_retry_interval     = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.max_overflow          = 50 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.max_pool_size         = 5 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.max_retries           = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.mysql_wsrep_sync_wait = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.pool_timeout          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.retry_interval        = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.slave_connection      = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.sqlite_synchronous    = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] database.use_db_reconnect      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.connection_string     = messaging:// {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.enabled               = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.es_doc_type           = notification {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.es_scroll_size        = 10000 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.es_scroll_time        = 2m {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.filter_error_trace    = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.hmac_keys             = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.sentinel_service_name = mymaster {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.socket_timeout        = 0.1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.trace_requests        = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler.trace_sqlalchemy      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler_jaeger.process_tags   = {} {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler_jaeger.service_name_prefix = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] profiler_otlp.service_name_prefix = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.enforce_new_defaults = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: WARNING oslo_config.cfg [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.enforce_scope      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.policy_default_rule = default {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.policy_file        = policy.yaml {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.group          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.helper_command = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] privsep_osbrick.user           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.group         = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.helper_command = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] cinder_sys_admin.user          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.auth_section      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.auth_type         = password {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.certfile          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.collect_timing    = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.insecure          = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.keyfile           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.send_service_user_token = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.split_loggers     = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] service_user.timeout           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.auth_section            = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.auth_type               = password {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.certfile                = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.collect_timing          = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.insecure                = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.keyfile                 = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.split_loggers           = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] glance.timeout                 = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.backend_availability_zone = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.chap_password = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.chap_username =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.driver_client_cert = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.driver_client_cert_key = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.driver_data_namespace = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.driver_use_ssl = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.extra_capabilities = {} {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.filter_function = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.goodness_function = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iscsi_iotype  = fileio {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iscsi_target_flags =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iscsi_write_cache = on {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iser_helper   = tgtadm {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iser_ip_address = 192.168.122.101 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iser_port     = 3260 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.lvm_share_target = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.lvm_type      = auto {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.num_shell_tries = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.replication_device = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.report_discard_supported = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.reserved_percentage = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.target_helper = tgtadm {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.target_ip_address = 192.168.122.101 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.target_port   = 3260 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.target_protocol = iscsi {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.trace_flags   = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.unique_fqdn_network = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.use_chap_auth = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_backend_name = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_clear  = zero {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_clear_ionice = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_clear_size = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_reports.file_event_handler = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_reports.log_dir           = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.backend_host       = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.chap_password      = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.chap_username      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.driver_client_cert = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.extra_capabilities = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.filter_function    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.goodness_function  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iscsi_iotype       = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iser_helper        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iser_ip_address    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iser_port          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.lvm_share_target   = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.lvm_type           = auto {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.num_shell_tries    = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.replication_device = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.report_discard_supported = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.reserved_percentage = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.scst_target_driver = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.storage_protocol   = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.target_helper      = lioadm {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.target_ip_address  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.target_port        = 3260 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:14 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.trace_flags        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.use_chap_auth      = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_clear       = zero {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_clear_size  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] lvmdriver-1.volumes_dir        = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.ssl      = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_notifications.driver = [] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_notifications.retry = -1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] key_manager.fixed_key          = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.barbican_api_version  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.barbican_endpoint     = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.barbican_endpoint_type = public {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.barbican_region_name  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.cafile                = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.certfile              = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.collect_timing        = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.insecure              = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.keyfile               = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.number_of_retries     = 60 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.retry_delay           = 1 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.send_service_user_token = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.split_loggers         = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.timeout               = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.verify_ssl            = True {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican.verify_ssl_path       = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.auth_section = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.auth_type = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.cafile   = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.certfile = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.collect_timing = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.insecure = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.keyfile  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.split_loggers = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] barbican_service_user.timeout  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.approle_role_id          = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.approle_secret_id        = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.kv_mountpoint            = secret {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.kv_path                  = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.kv_version               = 2 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.namespace                = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.root_token_id            = **** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.ssl_ca_crt_file          = None {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.timeout                  = 60.0 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.use_ssl                  = False {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:51:15 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] ******************************************************************************** {{(pid=76021) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 23 14:51:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.142s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.087s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:15 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:15 devstack sudo[76214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 23 14:51:15 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:17 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:17 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.065s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:17 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:17 devstack sudo[76334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:17 devstack sudo[76334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:19 devstack sudo[76334]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:19 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.962s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:19 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 14:51:19 devstack cinder-volume[76145]: INFO cinder.brick.local_dev.lvm [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 23 14:51:19 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:19 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:19 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:19 devstack sudo[76432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:51:19 devstack sudo[76432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:21 devstack sudo[76432]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:21 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.981s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:21 devstack cinder-volume[76145]: DEBUG cinder.brick.local_dev.lvm [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76145) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 23 14:51:21 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:21 devstack sudo[76530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:21 devstack sudo[76530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:24 devstack cinder-volume[76021]: DEBUG dbcounter [-] [76021] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76021) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:51:24 devstack sudo[76530]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:25 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.510s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:25 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:25 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.072s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:25 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:25 devstack sudo[76723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:25 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:27 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:27 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.963s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:27 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:27 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.069s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:27 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:27 devstack sudo[76760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 23 14:51:27 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:29 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:29 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.156s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:29 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:29 devstack sudo[76791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:51:29 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:32 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:32 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.514s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:32 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:33 devstack sudo[76884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:51:33 devstack sudo[76884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:35 devstack sudo[76884]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.772s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:35 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:35 devstack sudo[76889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:51:35 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:38 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:38 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.668s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:38 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:38 devstack sudo[76894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:38 devstack sudo[76894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:40 devstack sudo[76894]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:40 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.025s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:40 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:40 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.190s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:40 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:40 devstack sudo[76910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:40 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:42 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:42 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.905s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:42 devstack cinder-volume[76145]: INFO cinder.volume.drivers.lvm [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 23 14:51:42 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:42 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.069s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:42 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:42 devstack sudo[77018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:42 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:44 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.909s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:44 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:51:44 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:44 devstack sudo[77144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:51:44 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:46 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.027s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:46 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:46 devstack sudo[77163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:51:46 devstack sudo[77163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:49 devstack sudo[77163]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.354s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:49 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:49 devstack sudo[77167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:49 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:51 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.942s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:51 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:51 devstack sudo[77173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:51:51 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:53 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.881s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:53 devstack cinder-volume[76145]: INFO cinder.volume.driver [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG cinder.volume.driver [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76145) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG oslo_db.sqlalchemy.engines [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76145) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writer thread running {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG cinder.db.sqlalchemy.api [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Building query based on filter {{(pid=76145) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG cinder.image.image_utils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76145) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 23 14:51:53 devstack cinder-volume[76145]: INFO cinder.keymgr.migration [None req-add044f4-e7d4-4558-a0e1-e6c42af3a187 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:51:53 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:53 devstack sudo[77211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:51:53 devstack sudo[77211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:55 devstack sudo[77211]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:55 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.907s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:55 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:55 devstack sudo[77315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:51:55 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:57 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.982s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:57 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:57 devstack sudo[77325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:51:57 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:51:59 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root
Sep 23 14:51:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.836s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:51:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:51:59 devstack sudo[77328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:51:59 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:52:01 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root
Sep 23 14:52:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.767s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:52:01 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:52:01 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Driver initialization completed successfully.
Sep 23 14:52:01 devstack cinder-volume[76145]: INFO cinder.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Initiating service 2 cleanup
Sep 23 14:52:01 devstack cinder-volume[76145]: INFO cinder.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Service 2 cleanup completed.
Sep 23 14:52:01 devstack cinder-volume[76145]: DEBUG cinder.service [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Creating RPC server for service cinder-volume {{(pid=76145) start /opt/stack/cinder/cinder/service.py:239}}
Sep 23 14:52:01 devstack cinder-volume[76145]: DEBUG cinder.service [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76145) start /opt/stack/cinder/cinder/service.py:245}}
Sep 23 14:52:01 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 23 14:52:01 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:52:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:52:01 devstack sudo[77336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:52:01 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:52:04 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root
Sep 23 14:52:04 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.632s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:52:04 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:52:04 devstack sudo[77341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:52:04 devstack sudo[77341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:52:06 devstack sudo[77341]: pam_unix(sudo:session): session closed for user root
Sep 23 14:52:06 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.189s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:52:06 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:52:06 devstack sudo[77348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:52:06 devstack sudo[77348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:52:08 devstack sudo[77348]: pam_unix(sudo:session): session closed for user root
Sep 23 14:52:08 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.733s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:52:08 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:52:08 devstack sudo[77351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:52:08 devstack sudo[77351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:52:09 devstack sudo[77351]: pam_unix(sudo:session): session closed for user root
Sep 23 14:52:09 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.721s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:52:10 devstack cinder-volume[76145]: INFO cinder.volume.manager [None req-61855202-a7a9-4d0a-b088-acbfdfeba4b6 None None] Driver post RPC initialization completed successfully.
Sep 23 14:52:20 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=3 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:52:20 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:52:59 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 14:52:59 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:52:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:52:59 devstack sudo[78342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:52:59 devstack sudo[78342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:53:01 devstack sudo[78342]: pam_unix(sudo:session): session closed for user root
Sep 23 14:53:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.975s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:53:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:53:01 devstack sudo[78432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:53:01 devstack sudo[78432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:53:03 devstack sudo[78432]: pam_unix(sudo:session): session closed for user root
Sep 23 14:53:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.972s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:53:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:53:03 devstack sudo[78561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:53:03 devstack sudo[78561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:53:05 devstack sudo[78561]: pam_unix(sudo:session): session closed for user root
Sep 23 14:53:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.013s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:53:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:53:05 devstack sudo[78652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:53:05 devstack sudo[78652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:53:07 devstack sudo[78652]: pam_unix(sudo:session): session closed for user root
Sep 23 14:53:07 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.098s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:53:07 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:53:59 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 14:53:59 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:53:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:53:59 devstack sudo[79142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:53:59 devstack sudo[79142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:54:01 devstack sudo[79142]: pam_unix(sudo:session): session closed for user root
Sep 23 14:54:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.993s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:54:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:54:01 devstack sudo[79145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:54:01 devstack sudo[79145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:54:03 devstack sudo[79145]: pam_unix(sudo:session): session closed for user root
Sep 23 14:54:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.135s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:54:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:54:03 devstack sudo[79167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:54:03 devstack sudo[79167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:54:05 devstack sudo[79167]: pam_unix(sudo:session): session closed for user root
Sep 23 14:54:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.340s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:54:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:54:05 devstack sudo[79171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:54:05 devstack sudo[79171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:54:07 devstack sudo[79171]: pam_unix(sudo:session): session closed for user root
Sep 23 14:54:07 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.967s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:54:07 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:54:20 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:54:20 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:54:59 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 14:54:59 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:54:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:54:59 devstack sudo[82074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:54:59 devstack sudo[82074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:55:01 devstack sudo[82074]: pam_unix(sudo:session): session closed for user root
Sep 23 14:55:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.995s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:55:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:55:01 devstack sudo[82188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:55:01 devstack sudo[82188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:55:03 devstack sudo[82188]: pam_unix(sudo:session): session closed for user root
Sep 23 14:55:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.870s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:55:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:55:03 devstack sudo[82234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:55:03 devstack sudo[82234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:55:05 devstack sudo[82234]: pam_unix(sudo:session): session closed for user root
Sep 23 14:55:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.147s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:55:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:55:05 devstack sudo[82243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:55:05 devstack sudo[82243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:55:07 devstack sudo[82243]: pam_unix(sudo:session): session closed for user root
Sep 23 14:55:07 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.034s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:55:07 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:55:59 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 14:55:59 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:55:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:55:59 devstack sudo[82665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:55:59 devstack sudo[82665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:56:00 devstack sudo[82665]: pam_unix(sudo:session): session closed for user root
Sep 23 14:56:00 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.767s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:56:00 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:56:01 devstack sudo[82677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:56:01 devstack sudo[82677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:56:02 devstack sudo[82677]: pam_unix(sudo:session): session closed for user root
Sep 23 14:56:02 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.704s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:56:02 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:56:02 devstack sudo[82681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:56:02 devstack sudo[82681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:56:04 devstack sudo[82681]: pam_unix(sudo:session): session closed for user root
Sep 23 14:56:04 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.216s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:56:04 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:56:05 devstack sudo[82691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:56:05 devstack sudo[82691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:56:07 devstack sudo[82691]: pam_unix(sudo:session): session closed for user root
Sep 23 14:56:07 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.152s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:56:07 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:56:20 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:SELECT=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:56:20 devstack cinder-volume[76145]: DEBUG dbcounter [-] [76145] Writing DB stats cinder:UPDATE=1 {{(pid=76145) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:56:59 devstack cinder-volume[76145]: DEBUG oslo_service.periodic_task [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76145) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 14:56:59 devstack cinder-volume[76145]: DEBUG cinder.volume.drivers.lvm [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Updating volume stats {{(pid=76145) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 23 14:56:59 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:56:59 devstack sudo[82879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 23 14:56:59 devstack sudo[82879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:57:01 devstack sudo[82879]: pam_unix(sudo:session): session closed for user root
Sep 23 14:57:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.020s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:57:01 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:57:01 devstack sudo[82887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:57:01 devstack sudo[82887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:57:03 devstack sudo[82887]: pam_unix(sudo:session): session closed for user root
Sep 23 14:57:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.968s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:57:03 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:57:03 devstack sudo[82893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 23 14:57:03 devstack sudo[82893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:57:05 devstack sudo[82893]: pam_unix(sudo:session): session closed for user root
Sep 23 14:57:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.554s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:57:05 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:57:05 devstack sudo[82897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 23 14:57:05 devstack sudo[82897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 14:57:07 devstack sudo[82897]: pam_unix(sudo:session): session closed for user root
Sep 23 14:57:07 devstack cinder-volume[76145]: DEBUG oslo_concurrency.processutils [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.073s {{(pid=76145) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:57:07 devstack cinder-volume[76145]: DEBUG cinder.manager [None req-864ed6a6-730c-4113-8450-0d13c3187742 None None] Notifying Schedulers of capabilities ... {{(pid=76145) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:57:34 devstack cinder-volume[76021]: INFO oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Caught SIGTERM, stopping children
Sep 23 14:57:34 devstack cinder-volume[76021]: DEBUG oslo_concurrency.lockutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Acquiring lock "singleton_lock" {{(pid=76021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 23 14:57:34 devstack cinder-volume[76021]: DEBUG oslo_concurrency.lockutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Acquired lock "singleton_lock" {{(pid=76021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 23 14:57:34 devstack cinder-volume[76021]: DEBUG oslo_concurrency.lockutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Releasing lock "singleton_lock" {{(pid=76021) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 23 14:57:34 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Stop services. {{(pid=76021) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 23 14:57:34 devstack cinder-volume[76021]: DEBUG oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Killing children. {{(pid=76021) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 23 14:57:34 devstack cinder-volume[76021]: INFO oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Waiting on 1 children to exit
Sep 23 14:57:36 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Acquiring lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 23 14:57:36 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Acquired lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 23 14:57:36 devstack cinder-volume[76145]: DEBUG oslo_concurrency.lockutils [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Releasing lock "singleton_lock" {{(pid=76145) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 23 14:57:36 devstack cinder-volume[76145]: WARNING amqp [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 14:57:36 devstack cinder-volume[76145]: WARNING amqp [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 23 14:57:36 devstack cinder-volume[76021]: INFO oslo_service.backend._eventlet.service [None req-959763e2-3874-40e5-83a0-863ec614903b None None] Child 76145 exited with status 0
Sep 23 14:57:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 23 14:57:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 23 14:57:54 devstack cinder-volume[83804]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 23 14:57:57 devstack cinder-volume[83804]: INFO dbcounter [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Registered counter for database cinder
Sep 23 14:57:57 devstack cinder-volume[83804]: DEBUG oslo_db.sqlalchemy.engines [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:57:57 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writer thread running {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 23 14:57:58 devstack cinder-volume[83804]: INFO cinder.rpc [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 23 14:57:58 devstack cinder-volume[83804]: INFO cinder.rpc [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_db.sqlalchemy.engines [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:57:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Determined volume DB was empty at startup.
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG cinder.volume.manager [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83804) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 23 14:57:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 23 14:57:58 devstack cinder-volume[83804]: WARNING stevedore.named [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 23 14:57:58 devstack cinder-volume[83804]: WARNING castellan.key_manager [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 14:57:58 devstack cinder-volume[83804]: WARNING cinder.keymgr.conf_key_mgr [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 23 14:57:58 devstack cinder-volume[83804]: INFO cinder.volume.manager [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_db.sqlalchemy.engines [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:57:58 devstack cinder-volume[83804]: INFO oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Starting 1 workers
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Started child 84009 {{(pid=83804) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Full set of CONF: {{(pid=83804) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] ******************************************************************************** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Configuration options gathered from: {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] ================================================================================ {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] allow_availability_zone_fallback = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] allow_compression_on_image_upload = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] allowed_direct_url_schemes     = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] api_rate_limit                 = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] auth_strategy                  = keystone {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_availability_zone      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_host                   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_name                   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_stats_polling_interval = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backup_api_class               = cinder.backup.api.API {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backup_name_template           = backup-%s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backup_use_same_host           = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backup_use_temp_snapshot       = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] chap_password                  = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] chap_username                  =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_internal_tenant_project_id = f8c381caac75406f8ffb9690560f666e {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_internal_tenant_user_id = 2b15ab08858344a4bc10882cacdd5248 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cluster                        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] compression_format             = gzip {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] config_dir                     = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] config_source                  = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] control_exchange               = openstack {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] debug                          = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] default_availability_zone      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] default_group_type             = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] default_volume_type            = QuobyteHD {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] driver_client_cert             = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] driver_client_cert_key         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] driver_data_namespace          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] driver_ssl_cert_path           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] driver_ssl_cert_verify         = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] driver_use_ssl                 = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] enable_new_services            = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:58 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] enable_unsupported_driver      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] enforce_multipath_for_image_xfer = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] filter_function                = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_api_insecure            = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_api_servers             = ['http://192.168.122.101/image'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_api_ssl_compression     = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_ca_certificates_file    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_certfile                = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_keyfile                 = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_num_retries             = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance_request_timeout         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] goodness_function              = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] graceful_shutdown_timeout      = 5 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] group_api_class                = cinder.group.api.API {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] host                           = devstack {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_compress_on_upload       = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_conversion_address_space_limit = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_conversion_cpu_limit     = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[84009]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_conversion_disable       = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_upload_use_cinder_backend = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_upload_use_internal_tenant = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_volume_cache_enabled     = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_volume_cache_max_count   = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] image_volume_cache_max_size_gb = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] init_host_max_objects_retrieval = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iscsi_iotype                   = fileio {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iscsi_target_flags             =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iscsi_write_cache              = on {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iser_helper                    = tgtadm {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iser_ip_address                = 192.168.122.101 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iser_port                      = 3260 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_color                      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_config_append              = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_dir                        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_file                       = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_options                    = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_rotate_interval            = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_rotate_interval_type       = days {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] log_rotation_type              = none {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] max_age                        = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] max_logfile_count              = 30 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] max_logfile_size_mb            = 200 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] max_over_subscription_ratio    = 20.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] message_reap_interval          = 86400 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] message_ttl                    = 2592000 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] migration_create_volume_timeout_secs = 300 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] monkey_patch                   = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] monkey_patch_modules           = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] my_ip                          = 192.168.122.101 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] no_snapshot_gb_quota           = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] num_iser_scan_tries            = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] num_shell_tries                = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] num_volume_device_scan_tries   = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] nvmeof_conn_info_version       = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] nvmet_ns_id                    = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] nvmet_port_id                  = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_max_limit                = 1000 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_volume_ext_list          = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_volume_listen_port       = 8776 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_volume_use_ssl           = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] osapi_volume_workers           = 2 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] per_volume_size_limit          = -1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] periodic_fuzzy_delay           = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] periodic_interval              = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] public_endpoint                = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] publish_errors                 = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_backup_gigabytes         = 1000 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_backups                  = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_gigabytes                = 1000 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_groups                   = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_snapshots                = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] quota_volumes                  = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] rate_limit_burst               = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] rate_limit_except_level        = CRITICAL {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] rate_limit_interval            = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] reinit_driver_count            = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] replication_device             = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] report_discard_supported       = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] report_interval                = 120 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] reservation_clean_interval     = 86400 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] reservation_expire             = 86400 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] reserved_image_namespaces      = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] reserved_percentage            = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] rpc_response_timeout           = 120 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] run_external_periodic_tasks    = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] scst_target_driver             = iscsi {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] scst_target_iqn_name           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_down_time              = 720 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] shell_completion               = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] snapshot_name_template         = snapshot-%s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] split_loggers                  = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] state_path                     = /opt/stack/data/cinder {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] storage_availability_zone      = nova {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] storage_protocol               = iSCSI {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] syslog_log_facility            = LOG_USER {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] target_helper                  = lioadm {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] target_ip_address              = 192.168.122.101 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] target_port                    = 3260 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] target_protocol                = iscsi {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] target_secondary_ip_addresses  = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] trace_flags                    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] transport_url                  = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] until_refresh                  = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_chap_auth                  = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_default_quota_class        = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_journal                    = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_json                       = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_multipath_for_image_xfer   = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_stderr                     = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] use_syslog                     = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] verify_glance_signatures       = enabled {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_api_class               = cinder.volume.api.API {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_backend_name            = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_clear                   = zero {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_clear_ionice            = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_clear_size              = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_copy_bps_limit          = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_dd_blocksize            = 1M {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_name_template           = volume-%s {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_service_inithost_offload = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volume_usage_audit_period      = month {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] watch_log_file                 = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] zoning_mode                    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_concurrency.disable_process_locking = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.admin_password = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.admin_token = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.admin_user  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_protocol = https {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_section = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_type   = password {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_uri    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.auth_version = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.cache       = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.certfile    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.identity_uri = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.include_service_catalog = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.insecure    = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.interface   = public {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.keyfile     = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_password =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcache_username =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.region_name = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.service_type = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.backend                  = dogpile.cache.null {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.backend_argument         = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.backend_expiration_time  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.config_prefix            = cache.oslo {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.dead_timeout             = 60.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.debug_cache_backend      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.enable_retry_client      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.enable_socket_keepalive  = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.enabled                  = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.enforce_fips_mode        = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.expiration_time          = 600 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.hashclient_retry_attempts = 2 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_dead_retry      = 300 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_password        = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_sasl_enabled    = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.memcache_username        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.proxies                  = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_db                 = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_password           = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_server             = localhost:6379 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_socket_timeout     = 1.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.redis_username           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.retry_attempts           = 2 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.retry_delay              = 0.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.socket_keepalive_count   = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.socket_keepalive_idle    = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.socket_keepalive_interval = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.tls_allowed_ciphers      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.tls_cafile               = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.tls_certfile             = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.tls_enabled              = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cache.tls_keyfile              = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] coordination.backend_url       = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.asyncio_connection    = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.asyncio_slave_connection = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.backend               = sqlalchemy {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.connection            = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.connection_debug      = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.connection_parameters =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.connection_recycle_time = 3600 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.connection_trace      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.db_inc_retry_interval = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.db_max_retries        = 20 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.db_max_retry_interval = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.db_retry_interval     = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.max_overflow          = 50 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.max_pool_size         = 5 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.max_retries           = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.mysql_wsrep_sync_wait = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.pool_timeout          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.retry_interval        = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.slave_connection      = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.sqlite_synchronous    = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] database.use_db_reconnect      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.connection_string     = messaging:// {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.enabled               = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.es_doc_type           = notification {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.es_scroll_size        = 10000 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.es_scroll_time        = 2m {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.filter_error_trace    = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.hmac_keys             = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.sentinel_service_name = mymaster {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.socket_timeout        = 0.1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.trace_requests        = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler.trace_sqlalchemy      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler_jaeger.process_tags   = {} {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler_jaeger.service_name_prefix = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] profiler_otlp.service_name_prefix = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 14:57:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.enforce_new_defaults = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84009) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 23 14:57:59 devstack cinder-volume[83804]: WARNING oslo_config.cfg [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.enforce_scope      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.policy_default_rule = default {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.group          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.helper_command = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] privsep_osbrick.user           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.group         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.helper_command = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] cinder_sys_admin.user          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.auth_section      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.auth_type         = password {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.certfile          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.collect_timing    = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.insecure          = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.keyfile           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.send_service_user_token = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.split_loggers     = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] service_user.timeout           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.auth_section            = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.auth_type               = password {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.certfile                = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.collect_timing          = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.insecure                = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.keyfile                 = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.split_loggers           = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] glance.timeout                 = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.backend_availability_zone = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.chap_password = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.chap_username =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.driver_client_cert = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.driver_client_cert_key = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.driver_data_namespace = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.driver_use_ssl = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.extra_capabilities = {} {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.filter_function = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.goodness_function = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iscsi_target_flags =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iscsi_write_cache = on {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iser_ip_address = 192.168.122.101 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iser_port     = 3260 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_host      =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_login     = admin {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_mount_options = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_password  = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_private_key =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_share_path =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.num_shell_tries = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.quobyte_volume_url = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.replication_device = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.report_discard_supported = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.reserved_percentage = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.target_helper = tgtadm {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.target_ip_address = 192.168.122.101 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.target_port   = 3260 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.target_protocol = iscsi {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.trace_flags   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.unique_fqdn_network = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.use_chap_auth = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_backend_name = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_clear  = zero {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_clear_ionice = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_clear_size = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_reports.file_event_handler = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_reports.log_dir           = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.backend_availability_zone = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.backend_host         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.chap_password        = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.chap_username        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.driver_client_cert   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.driver_data_namespace = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.extra_capabilities   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.filter_function      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.goodness_function    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iscsi_iotype         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iser_helper          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iser_ip_address      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iser_port            = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_host             = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_login            = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_mount_options    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_password         = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_private_key      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_share_path       = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.num_shell_tries      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.replication_device   = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.report_discard_supported = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.reserved_percentage  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.scst_target_driver   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.storage_protocol     = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.target_helper        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.target_ip_address    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.target_port          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.target_prefix        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.target_protocol      = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.trace_flags          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.use_chap_auth        = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_clear         = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_clear_size    = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] QuobyteHD.volumes_dir          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_notifications.driver = [] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_notifications.retry = -1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] key_manager.fixed_key          = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.barbican_api_version  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.barbican_endpoint     = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.barbican_endpoint_type = public {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.barbican_region_name  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.cafile                = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.certfile              = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.collect_timing        = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.insecure              = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.keyfile               = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.number_of_retries     = 60 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.retry_delay           = 1 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.send_service_user_token = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.split_loggers         = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.timeout               = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.verify_ssl            = True {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican.verify_ssl_path       = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.auth_section = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.auth_type = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.cafile   = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.certfile = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.collect_timing = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.insecure = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.keyfile  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.split_loggers = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] barbican_service_user.timeout  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.approle_role_id          = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.approle_secret_id        = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.kv_mountpoint            = secret {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.kv_path                  = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.kv_version               = 2 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.namespace                = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.root_token_id            = **** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.ssl_ca_crt_file          = None {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.timeout                  = 60.0 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.use_ssl                  = False {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 23 14:57:59 devstack cinder-volume[83804]: DEBUG oslo_service.backend._eventlet.service [None req-5748b390-464d-48ed-a71d-6aaca8955680 None None] ******************************************************************************** {{(pid=83804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 23 14:57:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84009) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 23 14:57:59 devstack cinder-volume[84009]: INFO cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 23 14:57:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Running cmd (subprocess): mount.quobyte {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:58:00 devstack quobyte-client[84012]: Reading configuration file: /etc/quobyte/client.cfg
Sep 23 14:58:00 devstack quobyte-client[84012]: Invalid parameters found, error: missing mount point.
Sep 23 14:58:00 devstack quobyte-client[84012]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 23 14:58:00 devstack quobyte-client[84012]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] CMD "mount.quobyte" returned: 1 in 0.379s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 14:58:00 devstack cinder-volume[84009]: INFO cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Mounting volume: 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 ...
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c -c /etc/quobyte/client-cinder.cfg {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:58:00 devstack quobyte-client[84013]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 23 14:58:00 devstack quobyte-client[84013]: Reading configuration file: /etc/quobyte/client.cfg
Sep 23 14:58:00 devstack quobyte-client[84013]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c' to display the log.
Sep 23 14:58:00 devstack quobyte-client[84024]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 23 14:58:00 devstack quobyte-client[84024]: mount.quobyte 3.25 (4fbbd59204)
Sep 23 14:58:00 devstack quobyte-client[84024]: Client UUID: 7ERtze7t-TRF9-rWWl-rH1R-IvhfpWE0CzDi
Sep 23 14:58:00 devstack quobyte-client[84024]: Registry: osci01.corp.quobyte.com:7861
Sep 23 14:58:00 devstack quobyte-client[84024]: Volume: cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 14:58:00 devstack quobyte-client[84024]: FUSE version: 316
Sep 23 14:58:00 devstack quobyte-client[84024]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 23 14:58:00 devstack quobyte-client[84024]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 23 14:58:00 devstack quobyte-client[84024]: Setting total object cache size to 3352297472 bytes
Sep 23 14:58:00 devstack quobyte-client[84024]: Using FUSE low-level API
Sep 23 14:58:00 devstack quobyte-client[84024]: Caching of uid/gid to user/group name mappings is enabled
Sep 23 14:58:00 devstack quobyte-client[84024]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 23 14:58:00 devstack quobyte-client[84024]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 23 14:58:00 devstack quobyte-client[84024]: HTTP server started on port 55000
Sep 23 14:58:00 devstack quobyte-client[84024]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 23 14:58:00 devstack quobyte-client[84024]: Mount point /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c established
Sep 23 14:58:00 devstack quobyte-client[84024]: TimeSync is running and remote sync every 60 seconds
Sep 23 14:58:00 devstack quobyte-client[84024]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 23 14:58:00 devstack quobyte-client[84024]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 23 14:58:00 devstack quobyte-client[84024]: Opening volume cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 (7a917a49-1a31-4104-aff1-e7a96d1f1be3)
Sep 23 14:58:00 devstack quobyte-client[84024]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 23 14:58:00 devstack quobyte-client[84024]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 23 14:58:00 devstack quobyte-client[84024]: Changed metadata cache configuration for volume 7a917a49-1a31-4104-aff1-e7a96d1f1be3 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 23 14:58:00 devstack quobyte-client[84024]: Failed to invalidate inode: 38: Function not implemented
Sep 23 14:58:00 devstack quobyte-client[84024]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 23 14:58:00 devstack quobyte-client[84024]: Automatic minidump upload enabled by global system configuration
Sep 23 14:58:00 devstack quobyte-client[84024]: Announcing HTTP status server address 172.24.4.1
Sep 23 14:58:00 devstack quobyte-client[84024]: Registered as service (uuid 7ERtze7t-TRF9-rWWl-rH1R-IvhfpWE0CzDi)
Sep 23 14:58:00 devstack quobyte-client[84024]: Quobyte Client running as pid 84024
Sep 23 14:58:00 devstack quobyte-client[84024]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 23 14:58:00 devstack quobyte-client[84024]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.488s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:58:00 devstack cinder-volume[84009]: INFO cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Mounting volume: 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 succeeded
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.545s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:58:00 devstack quobyte-client[84024]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.087s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:58:00 devstack cinder-volume[84009]: INFO cinder.volume.driver [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Driver hasn't implemented _init_vendor_properties()
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG cinder.volume.driver [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84009) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG oslo_db.sqlalchemy.engines [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 23 14:58:00 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writer thread running {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.db.sqlalchemy.api [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Building query based on filter {{(pid=84009) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84009) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 23 14:58:01 devstack cinder-volume[84009]: INFO cinder.keymgr.migration [None req-a1207f4b-7506-4561-b69c-6eeab8c7ffee None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.075s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:58:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Driver initialization completed successfully.
Sep 23 14:58:01 devstack cinder-volume[84009]: INFO cinder.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Initiating service 3 cleanup
Sep 23 14:58:01 devstack cinder-volume[84009]: INFO cinder.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Service 3 cleanup completed.
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.service [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Creating RPC server for service cinder-volume {{(pid=84009) start /opt/stack/cinder/cinder/service.py:239}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.service [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84009) start /opt/stack/cinder/cinder/service.py:245}}
Sep 23 14:58:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 23 14:58:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 14:58:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:58:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.092s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:58:02 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-be12e599-1628-4799-a76e-d65df9f72acf None None] Driver post RPC initialization completed successfully.
Sep 23 14:58:03 devstack quobyte-client[84024]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 23 14:58:08 devstack cinder-volume[83804]: DEBUG dbcounter [-] [83804] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:58:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:58:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.249s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:59:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 14:59:19 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 14:59:19 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 14:59:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Flow 'volume_create_manager' (068d6a44-7fe0-48f3-ad89-919eb465dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 14:59:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f472fc21-bce2-4ca3-a6e7-97659fc11043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f472fc21-bce2-4ca3-a6e7-97659fc11043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T12:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1941007967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffe493e-52a5-4ceb-a653-8f2b6fd23728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554a09fe15f14d4fa02a738ecedaf5f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T12:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T12:59:19Z,use_quota=True,user_id='fcc7e8694c214beca340ef871a8943c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56b6b8c-2310-4f0f-8ac4-f90c2e05d0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56b6b8c-2310-4f0f-8ac4-f90c2e05d0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96708515-2a8f-4496-aff6-6be59e6f1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96708515-2a8f-4496-aff6-6be59e6f1773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffe493e-52a5-4ceb-a653-8f2b6fd23728', 'volume_name': 'volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6479774a-46c3-4d92-aca0-684ccc945a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6479774a-46c3-4d92-aca0-684ccc945a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3834f4a-1e18-4bb2-a25e-4c93c24779fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:20 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume 1ffe493e-52a5-4ceb-a653-8f2b6fd23728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728', 'volume_size': 1}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T12:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1941007967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffe493e-52a5-4ceb-a653-8f2b6fd23728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='554a09fe15f14d4fa02a738ecedaf5f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T12:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T12:59:19Z,use_quota=True,user_id='fcc7e8694c214beca340ef871a8943c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Creating volume 1ffe493e-52a5-4ceb-a653-8f2b6fd23728 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 14:59:20 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 14:59:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:59:20 devstack quobyte-client[84024]: System call of process 84357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 14:59:21 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=2, name=volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 14:59:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 1073741824" returned: 0 in 1.156s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:59:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" returned: 0 in 0.249s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] <== create_volume: return (1646ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3834f4a-1e18-4bb2-a25e-4c93c24779fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c92f25-791e-40fb-b209-abc76fd6d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:22 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 (1ffe493e-52a5-4ceb-a653-8f2b6fd23728): created successfully
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c92f25-791e-40fb-b209-abc76fd6d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Flow 'volume_create_manager' (068d6a44-7fe0-48f3-ad89-919eb465dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 14:59:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0d1b2b78-a2fe-4bf3-9de3-8ad1fee77940 tempest-VolumesAssistedSnapshotsTest-586107686 None] Created volume successfully.
Sep 23 14:59:32 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:59:32 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 14:59:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 14:59:53 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 14:59:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Flow 'volume_create_manager' (a17d15d2-c662-40e2-9127-ad75775a94bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 14:59:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6434d6f0-125c-4b06-ada9-5d5a3ff6c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6434d6f0-125c-4b06-ada9-5d5a3ff6c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T12:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-994766076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f719d138-332e-4eee-8bf8-9628de1013f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b690187f334026a25815a32e3a4298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T12:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T12:59:53Z,use_quota=True,user_id='d77096f699c44bd1b879e749ed6c3754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a30516-dd63-4aac-b34a-24ddfc276ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a30516-dd63-4aac-b34a-24ddfc276ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff8c66c-29ea-441b-9489-de70a3831f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff8c66c-29ea-441b-9489-de70a3831f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f719d138-332e-4eee-8bf8-9628de1013f7', 'volume_name': 'volume-f719d138-332e-4eee-8bf8-9628de1013f7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066a543a-52ac-4c42-b7cc-833a79ef91cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066a543a-52ac-4c42-b7cc-833a79ef91cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee94082d-a911-4747-9885-063e1995d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:54 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Volume f719d138-332e-4eee-8bf8-9628de1013f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f719d138-332e-4eee-8bf8-9628de1013f7', 'volume_size': 1}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T12:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-994766076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f719d138-332e-4eee-8bf8-9628de1013f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b690187f334026a25815a32e3a4298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T12:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T12:59:53Z,use_quota=True,user_id='d77096f699c44bd1b879e749ed6c3754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Creating volume f719d138-332e-4eee-8bf8-9628de1013f7 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.138s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 14:59:54 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 14:59:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:59:55 devstack quobyte-client[84024]: System call of process 84875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 14:59:55 devstack quobyte-client[84024]: System call of process 84875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 14:59:55 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=3, name=volume-f719d138-332e-4eee-8bf8-9628de1013f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 14:59:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7 1073741824" returned: 0 in 1.790s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:59:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 14:59:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7" returned: 0 in 0.345s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 14:59:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] <== create_volume: return (2737ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 14:59:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.824s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 14:59:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee94082d-a911-4747-9885-063e1995d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f719d138-332e-4eee-8bf8-9628de1013f7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b7485e-2bae-460d-8e8d-9e406915aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 14:59:58 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Volume volume-f719d138-332e-4eee-8bf8-9628de1013f7 (f719d138-332e-4eee-8bf8-9628de1013f7): created successfully
Sep 23 14:59:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b7485e-2bae-460d-8e8d-9e406915aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 14:59:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Flow 'volume_create_manager' (a17d15d2-c662-40e2-9127-ad75775a94bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 14:59:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7ce23940-5a64-413a-bbee-8c433077dd91 tempest-VolumesAdminNegativeTest-935522515 None] Created volume successfully.
Sep 23 15:00:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Acquiring lock "cinder-f719d138-332e-4eee-8bf8-9628de1013f7-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:00:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Lock "cinder-f719d138-332e-4eee-8bf8-9628de1013f7-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:00:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:00:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Acquiring lock "cinder-quobyte-f719d138-332e-4eee-8bf8-9628de1013f7" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:00:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Lock "cinder-quobyte-f719d138-332e-4eee-8bf8-9628de1013f7" acquired by "delete_volume" :: waited 0.329s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:00:03 devstack cinder-volume[84009]: INFO oslo.privsep.daemon [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptv0ictg8/privsep.sock']
Sep 23 15:00:03 devstack sudo[84951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptv0ictg8/privsep.sock
Sep 23 15:00:03 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.303s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:00:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:00:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:00:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:00:21 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root
Sep 23 15:00:21 devstack cinder-volume[84009]: INFO oslo.privsep.daemon [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Spawned new privsep daemon via rootwrap
Sep 23 15:00:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Accepted privsep connection to /tmp/tmptv0ictg8/privsep.sock {{(pid=84009) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 23 15:00:21 devstack cinder-volume[84009]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 23 15:00:21 devstack cinder-volume[84009]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 23 15:00:21 devstack cinder-volume[84009]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 23 15:00:21 devstack cinder-volume[84009]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85024
Sep 23 15:00:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a234ab-f692-4d5c-a390-75d967595267]: (2,) {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:00:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d46efba-a66e-4fd8-935f-6d495e008017]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:00:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:00:23 devstack quobyte-client[84024]: System call of process 85059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:00:23 devstack quobyte-client[84024]: System call of process 85059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:00:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7" returned: 0 in 1.989s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:00:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:00:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f719d138-332e-4eee-8bf8-9628de1013f7" returned: 0 in 0.388s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:00:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Lock "cinder-quobyte-f719d138-332e-4eee-8bf8-9628de1013f7" released by "delete_volume" :: held 21.846s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:00:25 devstack cinder-volume[84009]: WARNING cinder.quota [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:00:25 devstack cinder-volume[84009]: WARNING cinder.quota [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:00:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Created reservations ['a4fa8586-e67f-427b-95f0-07e5a641f0d5', 'f20a2484-9687-4c62-b388-633dfc73c88a', '8a1b5158-3424-443c-a493-79edd5ef5ef8', 'a5f64064-6e02-4885-a49c-e8e9921c4b23'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.369s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:00:26 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:00:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Deleted volume successfully.
Sep 23 15:00:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65aeac0f-88e3-4991-a76c-cc8f282bed3f tempest-VolumesAdminNegativeTest-935522515 None] Lock "cinder-f719d138-332e-4eee-8bf8-9628de1013f7-delete_volume" released by "delete_volume" :: held 26.878s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:00:36 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:00:38 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:01:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Flow 'volume_create_manager' (a844bd98-565d-48ba-9406-9924bd3a3d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e195ffc-2a03-4e9a-aae2-8a0ef447c769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e195ffc-2a03-4e9a-aae2-8a0ef447c769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1014295555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784410d2a03f487b834c9f6df3725929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:01:07Z,use_quota=True,user_id='6a8bed82e5544036b85e900b3f632cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d658199-0371-4af9-9744-0be645337a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d658199-0371-4af9-9744-0be645337a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876267f6-fdba-4213-85fa-a6ccb1290319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876267f6-fdba-4213-85fa-a6ccb1290319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2', 'volume_name': 'volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb36485a-7962-4a73-bd3e-db18210301d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb36485a-7962-4a73-bd3e-db18210301d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ec2600-67e8-41c0-be81-533f8b7f5d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:07 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume 4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2', 'volume_size': 1}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1014295555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784410d2a03f487b834c9f6df3725929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:01:07Z,use_quota=True,user_id='6a8bed82e5544036b85e900b3f632cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Creating volume 4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:01:07 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:07 devstack quobyte-client[84024]: System call of process 85309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:07 devstack quobyte-client[84024]: System call of process 85309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:07 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=4, name=volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 1073741824" returned: 0 in 0.568s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" returned: 0 in 0.122s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] <== create_volume: return (832ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ec2600-67e8-41c0-be81-533f8b7f5d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38b5a2d-9623-4ca9-9eef-15c867d249a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.461s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:01:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 (4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2): created successfully
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38b5a2d-9623-4ca9-9eef-15c867d249a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Flow 'volume_create_manager' (a844bd98-565d-48ba-9406-9924bd3a3d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:01:08 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1223d88d-e33f-4a00-832a-c0c93cf07fcf tempest-AttachVolumeShelveTestJSON-1776733145 None] Created volume successfully.
Sep 23 15:01:18 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:01:18 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:01:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77d556-a8a7-4a84-bfc2-79f702af77d7]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:01:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:46 devstack quobyte-client[84024]: System call of process 85512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:47 devstack quobyte-client[84024]: System call of process 85512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:47 devstack quobyte-client[84024]: System call of process 85512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" returned: 0 in 1.353s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.465s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.621s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:47 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a96af7-a1b8-48cb-903a-e57bd47b6f37]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:01:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:48 devstack quobyte-client[84024]: System call of process 85554 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:48 devstack quobyte-client[84024]: System call of process 85554 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" returned: 0 in 1.043s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.334s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '936498fa-9bb3-42a8-b10b-eabff4a54a4b', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:01:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:01:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36bcc4ee-124a-42fe-bdda-e679ddefa4c2', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:01:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:01:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-6f4b73d0-c1f2-4365-be73-91a511add8ae req-9b881d60-31dc-4441-908a-da9dab2f64e3 tempest-VolumesAssistedSnapshotsTest-586107686 None] attachment_update completed successfully.
Sep 23 15:01:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-b67b1a97-946e-4115-9bbc-9bfed3445dfb req-e64721d1-5011-4e0a-a697-b571c8320c93 tempest-AttachVolumeShelveTestJSON-1776733145 None] attachment_update completed successfully.
Sep 23 15:01:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Flow 'volume_create_manager' (32971ed8-fb58-4601-8a18-22c7a62ffe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62451870-2bc5-4879-912d-28506eb773a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62451870-2bc5-4879-912d-28506eb773a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-274571135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbeb99196f404ef58323aa8747c64b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:01:57Z,use_quota=True,user_id='6bd1681c1b91468498bded5204f6e27f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d4f3c2-ea96-44a8-a436-7f2d34770c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d4f3c2-ea96-44a8-a436-7f2d34770c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2303c36b-b425-4875-b02e-d8080240d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2303c36b-b425-4875-b02e-d8080240d064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6', 'volume_name': 'volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae746bd-902d-4e82-9b96-528e83fe4c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae746bd-902d-4e82-9b96-528e83fe4c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a411f74-7baf-42e6-be16-e4908569cbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:56 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Volume aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6', 'volume_size': 1}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-274571135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbeb99196f404ef58323aa8747c64b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:01:57Z,use_quota=True,user_id='6bd1681c1b91468498bded5204f6e27f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Creating volume aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:01:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:01:57 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:57 devstack quobyte-client[84024]: System call of process 85970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:01:57 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=5, name=volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 1073741824" returned: 0 in 0.518s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" returned: 0 in 0.187s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] <== create_volume: return (801ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:01:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:01:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a411f74-7baf-42e6-be16-e4908569cbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37c141e-d788-49b4-a55b-15c11d22b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:01:58 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Volume volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 (aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6): created successfully
Sep 23 15:01:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37c141e-d788-49b4-a55b-15c11d22b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:01:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Flow 'volume_create_manager' (32971ed8-fb58-4601-8a18-22c7a62ffe79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:01:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-43a6dcf6-a101-4a17-8ade-e5c180d77fcf tempest-DeleteServersTestJSON-939636282 None] Created volume successfully.
Sep 23 15:02:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:02:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d5222f-4e24-467a-9712-4f060085bf5e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.047s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.108s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.324s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:02:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" returned: 0 in 1.424s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.519s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:02:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ccb92df-352b-46a8-a8a0-8ba9bba48b8d', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:02:09 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-1ded3c70-6240-489d-a6a8-c9532833e019 req-2d188c5e-6bc4-43b4-8a24-a372aedcebf6 tempest-DeleteServersTestJSON-939636282 None] attachment_update completed successfully.
Sep 23 15:02:20 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:02:20 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:02:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-0eb19bec-76ee-44cc-bfe7-2f322e0dcd82 req-326dbe0c-9bee-4c9f-bbdb-2cdd673233fb tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-0eb19bec-76ee-44cc-bfe7-2f322e0dcd82 req-326dbe0c-9bee-4c9f-bbdb-2cdd673233fb tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:23 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-0eb19bec-76ee-44cc-bfe7-2f322e0dcd82 req-326dbe0c-9bee-4c9f-bbdb-2cdd673233fb tempest-VolumesAssistedSnapshotsTest-586107686 None] Terminate volume connection completed successfully.
Sep 23 15:02:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-0eb19bec-76ee-44cc-bfe7-2f322e0dcd82 req-326dbe0c-9bee-4c9f-bbdb-2cdd673233fb tempest-VolumesAssistedSnapshotsTest-586107686 None] Deleting attachment 36bcc4ee-124a-42fe-bdda-e679ddefa4c2. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:02:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Acquiring lock "cinder-1ffe493e-52a5-4ceb-a653-8f2b6fd23728-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:02:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "cinder-1ffe493e-52a5-4ceb-a653-8f2b6fd23728-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:02:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Acquiring lock "cinder-quobyte-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:02:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "cinder-quobyte-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" acquired by "delete_volume" :: waited 0.021s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:02:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9131ca0a-d8f7-48bb-a729-35e009eb7b12]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:02:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" returned: 0 in 1.016s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" returned: 0 in 0.181s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-9cccf552-22a8-46e1-af3d-77abfbc4dc97 req-0a3fb429-7b6d-4c92-87dd-8b4f1bb2f854 tempest-DeleteServersTestJSON-939636282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "cinder-quobyte-1ffe493e-52a5-4ceb-a653-8f2b6fd23728" released by "delete_volume" :: held 1.718s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:02:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-9cccf552-22a8-46e1-af3d-77abfbc4dc97 req-0a3fb429-7b6d-4c92-87dd-8b4f1bb2f854 tempest-DeleteServersTestJSON-939636282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-9cccf552-22a8-46e1-af3d-77abfbc4dc97 req-0a3fb429-7b6d-4c92-87dd-8b4f1bb2f854 tempest-DeleteServersTestJSON-939636282 None] Terminate volume connection completed successfully.
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-9cccf552-22a8-46e1-af3d-77abfbc4dc97 req-0a3fb429-7b6d-4c92-87dd-8b4f1bb2f854 tempest-DeleteServersTestJSON-939636282 None] Deleting attachment 5ccb92df-352b-46a8-a8a0-8ba9bba48b8d. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Created reservations ['9a8b6eb8-f942-4ae5-8ac8-d537e62e19de', 'f88af3b8-1f93-4ef5-a6b4-13cfdcde03d2', 'ed01b9ad-e34f-4e23-9bfc-9f12ecbc9c31', '5fe98620-7c46-4cf7-a28c-d41a854e574f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.119s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:27 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:02:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Deleted volume successfully.
Sep 23 15:02:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04ec9d21-8330-4d72-a59f-9d4bfd7a436a tempest-VolumesAssistedSnapshotsTest-586107686 None] Lock "cinder-1ffe493e-52a5-4ceb-a653-8f2b6fd23728-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:02:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Acquiring lock "cinder-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:02:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Lock "cinder-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:02:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:02:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Acquiring lock "cinder-quobyte-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:02:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Lock "cinder-quobyte-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" acquired by "delete_volume" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:02:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d97cd9-2a78-42eb-90b1-1a33b5613b92]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:02:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:31 devstack quobyte-client[84024]: System call of process 86259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:02:31 devstack quobyte-client[84024]: System call of process 86259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:02:31 devstack quobyte-client[84024]: System call of process 86259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:02:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" returned: 0 in 0.587s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" returned: 0 in 0.150s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Lock "cinder-quobyte-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6" released by "delete_volume" :: held 0.941s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:02:32 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Created reservations ['b034a4d5-c922-4780-af97-a1d7965c4050', '6677753e-dea9-459a-84bc-f29afb977e40', 'b4245212-82be-427e-8e63-31cf86876929', '4e7b05ee-c299-469f-a9dd-2b7c78badf98'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.074s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.144s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:02:33 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Deleted volume successfully.
Sep 23 15:02:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-321d7834-5d96-4e07-9548-99cc43f16050 tempest-DeleteServersTestJSON-939636282 None] Lock "cinder-aa0a67b3-8cf4-4341-9bd9-3ea5a2997aa6-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:02:43 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:02:43 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=13,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.328s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:03:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.108s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:04:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:04:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:04:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-36ec8167-263a-41ca-a66f-7c2985e82c3f req-1b2256ce-5524-49b6-a9cb-0b7b166cd1a3 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:04:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-36ec8167-263a-41ca-a66f-7c2985e82c3f req-1b2256ce-5524-49b6-a9cb-0b7b166cd1a3 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:04:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-36ec8167-263a-41ca-a66f-7c2985e82c3f req-1b2256ce-5524-49b6-a9cb-0b7b166cd1a3 tempest-AttachVolumeShelveTestJSON-1776733145 None] Terminate volume connection completed successfully.
Sep 23 15:04:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-36ec8167-263a-41ca-a66f-7c2985e82c3f req-1b2256ce-5524-49b6-a9cb-0b7b166cd1a3 tempest-AttachVolumeShelveTestJSON-1776733145 None] Deleting attachment 936498fa-9bb3-42a8-b10b-eabff4a54a4b. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:04:26 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:04:26 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:04:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:04:46 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:04:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Flow 'volume_create_manager' (5adb361e-c518-42e0-95e7-e17528e00501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:04:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3c3a3e-7fd9-4649-abba-e9405275e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3c3a3e-7fd9-4649-abba-e9405275e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916690829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4b01b8-99c0-4d82-af89-cceaba24cf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8afbb22defc4d879f0f9988ebb83d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:04:46Z,use_quota=True,user_id='dfa34df99b9c4ca08544f083188efc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5645d65a-7a87-4ba5-a7bd-5fec658bdace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5645d65a-7a87-4ba5-a7bd-5fec658bdace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b4e00f-42c5-40f9-8864-e2f201c5c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b4e00f-42c5-40f9-8864-e2f201c5c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4b01b8-99c0-4d82-af89-cceaba24cf28', 'volume_name': 'volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c9897d-d63c-4c40-ba1d-e5b42d41896f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c9897d-d63c-4c40-ba1d-e5b42d41896f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46dcc7db-f8ee-4402-b2ff-c3d2ef4cf8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:04:47 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Volume ae4b01b8-99c0-4d82-af89-cceaba24cf28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28', 'volume_size': 1}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916690829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4b01b8-99c0-4d82-af89-cceaba24cf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8afbb22defc4d879f0f9988ebb83d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:04:46Z,use_quota=True,user_id='dfa34df99b9c4ca08544f083188efc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Creating volume ae4b01b8-99c0-4d82-af89-cceaba24cf28 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:04:47 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:04:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:04:47 devstack quobyte-client[84024]: System call of process 87193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:04:47 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=6, name=volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 1073741824" returned: 0 in 0.864s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28" returned: 0 in 0.110s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] <== create_volume: return (1097ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46dcc7db-f8ee-4402-b2ff-c3d2ef4cf8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7343eaf5-c8cb-4c06-860c-4d545ded0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:04:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Volume volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 (ae4b01b8-99c0-4d82-af89-cceaba24cf28): created successfully
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7343eaf5-c8cb-4c06-860c-4d545ded0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:04:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Flow 'volume_create_manager' (5adb361e-c518-42e0-95e7-e17528e00501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:04:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-374e8876-69db-4ce8-a22f-fd58760c788d tempest-AttachVolumeTestJSON-1776661476 None] Created volume successfully.
Sep 23 15:04:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:04:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:04:56 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07ecd4-33d4-4bdd-9749-543c95065ba0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:04:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:04:57 devstack quobyte-client[84024]: System call of process 87255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:04:57 devstack quobyte-client[84024]: System call of process 87255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:04:57 devstack quobyte-client[84024]: System call of process 87255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:04:57 devstack quobyte-client[84024]: System call of process 87255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:04:57 devstack quobyte-client[84024]: System call of process 87255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:04:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28" returned: 0 in 0.680s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:04:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:04:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaa8020d-264d-47a8-86cc-39ad772e022e', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:04:57 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:04:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-15eaea79-75a2-47a2-8058-e9a72b5c68a0 req-938d35ec-0995-4880-a093-e02e4c2987e5 tempest-AttachVolumeTestJSON-1776661476 None] attachment_update completed successfully.
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1,cinder:SELECT=7 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:05:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.484s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:05:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:05:49 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Flow 'volume_create_manager' (6dfc9420-d8bc-4776-b6f2-e6d0909bde04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d074fb-c916-4a2a-bfc5-c4e1cef4aa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d074fb-c916-4a2a-bfc5-c4e1cef4aa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1877301616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a6386-b08a-47c2-b8de-21eb0dfe74b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9b85f7c8484f8c81dafcd52dbc15f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:05:49Z,use_quota=True,user_id='692693932b2542f68716af46dde6a328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b56d58-0f1d-468e-aff6-6ffb560074ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b56d58-0f1d-468e-aff6-6ffb560074ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca63df0-6b92-40e8-929c-ae2d83c4f3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca63df0-6b92-40e8-929c-ae2d83c4f3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061a6386-b08a-47c2-b8de-21eb0dfe74b8', 'volume_name': 'volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc57905-bccd-4a83-a556-de4ad012fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc57905-bccd-4a83-a556-de4ad012fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dab2d9-48f1-40a3-9917-1d2cdf8e508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:05:49 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume 061a6386-b08a-47c2-b8de-21eb0dfe74b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8', 'volume_size': 1}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1877301616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a6386-b08a-47c2-b8de-21eb0dfe74b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc9b85f7c8484f8c81dafcd52dbc15f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:05:49Z,use_quota=True,user_id='692693932b2542f68716af46dde6a328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Creating volume 061a6386-b08a-47c2-b8de-21eb0dfe74b8 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:05:49 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:05:49 devstack quobyte-client[84024]: System call of process 88374 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:05:49 devstack quobyte-client[84024]: System call of process 88374 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:05:49 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=7, name=volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 1073741824" returned: 0 in 0.423s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8" returned: 0 in 0.127s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] <== create_volume: return (632ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:05:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.645s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:05:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dab2d9-48f1-40a3-9917-1d2cdf8e508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:05:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53ea12-bce0-40f6-88c6-bfb366c7f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:05:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 (061a6386-b08a-47c2-b8de-21eb0dfe74b8): created successfully
Sep 23 15:05:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd53ea12-bce0-40f6-88c6-bfb366c7f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:05:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Flow 'volume_create_manager' (6dfc9420-d8bc-4776-b6f2-e6d0909bde04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:05:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-dbc601c7-8e26-4bf9-88d5-286c6daf4ea4 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Created volume successfully.
Sep 23 15:05:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:05:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:05:55 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1594c2af-dc3f-4e55-b9a2-e671dcbc5621]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:05:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:05:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8" returned: 0 in 0.636s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:05:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.757s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:05:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56ef7b04-14ba-4e3a-97c4-5b29f2fad71c', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:05:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:05:56 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-f195d947-ed9f-4b66-a4df-57c838dfd5ed req-991b85af-ed9e-44df-b0e5-bff1666e2953 tempest-AttachSCSIVolumeTestJSON-1411986180 None] attachment_update completed successfully.
Sep 23 15:06:06 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.138s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:06:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:06:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=7,cinder:DELETE=1,cinder:UPDATE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:06:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-2f8a927f-1626-4fbe-9ac1-426bd38ec942 req-89847fae-4810-4770-ae6a-f32d862eebf9 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:06:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-2f8a927f-1626-4fbe-9ac1-426bd38ec942 req-89847fae-4810-4770-ae6a-f32d862eebf9 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:06:25 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-2f8a927f-1626-4fbe-9ac1-426bd38ec942 req-89847fae-4810-4770-ae6a-f32d862eebf9 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Terminate volume connection completed successfully.
Sep 23 15:06:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-2f8a927f-1626-4fbe-9ac1-426bd38ec942 req-89847fae-4810-4770-ae6a-f32d862eebf9 tempest-AttachSCSIVolumeTestJSON-1411986180 None] Deleting attachment 56ef7b04-14ba-4e3a-97c4-5b29f2fad71c. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:06:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:06:31 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Flow 'volume_create_manager' (e06d164e-3729-41c8-a421-2bffce8978b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9614f606-feeb-4c76-bbf8-2260e6122c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9614f606-feeb-4c76-bbf8-2260e6122c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-826488972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5682d3-7215-4402-8211-c997c81d949a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784410d2a03f487b834c9f6df3725929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:06:32Z,use_quota=True,user_id='6a8bed82e5544036b85e900b3f632cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584e0ea1-2972-4c8b-98fd-597dc65c71f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584e0ea1-2972-4c8b-98fd-597dc65c71f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c1279f-916c-4bbd-b6cb-6388f74643ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c1279f-916c-4bbd-b6cb-6388f74643ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5682d3-7215-4402-8211-c997c81d949a', 'volume_name': 'volume-ed5682d3-7215-4402-8211-c997c81d949a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc192f-08ff-4084-b970-eba7efeaafe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc192f-08ff-4084-b970-eba7efeaafe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b097c6d-93d4-425a-b8e1-88344447e3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:06:32 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume ed5682d3-7215-4402-8211-c997c81d949a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5682d3-7215-4402-8211-c997c81d949a', 'volume_size': 1}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-826488972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5682d3-7215-4402-8211-c997c81d949a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784410d2a03f487b834c9f6df3725929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:06:32Z,use_quota=True,user_id='6a8bed82e5544036b85e900b3f632cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Creating volume ed5682d3-7215-4402-8211-c997c81d949a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:06:32 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:06:32 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=8, name=volume-ed5682d3-7215-4402-8211-c997c81d949a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a 1073741824" returned: 0 in 0.517s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a" returned: 0 in 0.148s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:06:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:06:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b097c6d-93d4-425a-b8e1-88344447e3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5682d3-7215-4402-8211-c997c81d949a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:06:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01579232-9302-482c-b5ea-5b0e9d094098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:06:33 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume volume-ed5682d3-7215-4402-8211-c997c81d949a (ed5682d3-7215-4402-8211-c997c81d949a): created successfully
Sep 23 15:06:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01579232-9302-482c-b5ea-5b0e9d094098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:06:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Flow 'volume_create_manager' (e06d164e-3729-41c8-a421-2bffce8978b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:06:33 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6c385bba-e06c-4787-a5ad-268ec9f70795 tempest-AttachVolumeShelveTestJSON-1776733145 None] Created volume successfully.
Sep 23 15:06:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Acquiring lock "cinder-061a6386-b08a-47c2-b8de-21eb0dfe74b8-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:06:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "cinder-061a6386-b08a-47c2-b8de-21eb0dfe74b8-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:06:40 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:06:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Acquiring lock "cinder-quobyte-061a6386-b08a-47c2-b8de-21eb0dfe74b8" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:06:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "cinder-quobyte-061a6386-b08a-47c2-b8de-21eb0dfe74b8" acquired by "delete_volume" :: waited 0.056s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:06:40 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d1755-b2e3-4e05-b7ec-53e57310dc95]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:06:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:06:41 devstack quobyte-client[84024]: System call of process 88631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:06:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8" returned: 0 in 0.639s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:06:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:06:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-061a6386-b08a-47c2-b8de-21eb0dfe74b8" returned: 0 in 0.211s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:06:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "cinder-quobyte-061a6386-b08a-47c2-b8de-21eb0dfe74b8" released by "delete_volume" :: held 1.109s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Created reservations ['09c18dfb-102e-4dd7-8a79-ac4dd696716c', '9ab2f551-104e-494f-8d29-ec9d2e4d4ccf', '716deb1f-6eaa-4368-b57b-1ed1d83e2a21', '164f5ee9-696d-44e3-a709-42be15bb329e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.121s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:06:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Deleted volume successfully.
Sep 23 15:06:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-19dd5d0d-fe36-4181-8036-dbb4b04e1b6a tempest-AttachSCSIVolumeTestJSON-1411986180 None] Lock "cinder-061a6386-b08a-47c2-b8de-21eb0dfe74b8-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:06:52 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:06:52 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:06:57 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-0b8bed42-07fd-41c8-b168-ffeb88a1aae6 req-14bd9ca0-9936-45ea-82dd-5bb68473c864 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:06:57 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-0b8bed42-07fd-41c8-b168-ffeb88a1aae6 req-14bd9ca0-9936-45ea-82dd-5bb68473c864 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:06:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-0b8bed42-07fd-41c8-b168-ffeb88a1aae6 req-14bd9ca0-9936-45ea-82dd-5bb68473c864 tempest-AttachVolumeShelveTestJSON-1776733145 None] No connector for attachment 15425322-be00-4feb-a8f7-5e25dfdb15b2; skipping storage backend terminate_connection call. {{(pid=84009) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 23 15:06:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-0b8bed42-07fd-41c8-b168-ffeb88a1aae6 req-14bd9ca0-9936-45ea-82dd-5bb68473c864 tempest-AttachVolumeShelveTestJSON-1776733145 None] Deleting attachment 15425322-be00-4feb-a8f7-5e25dfdb15b2. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:07:07 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.200s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:07:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:07:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-d13b1db6-79a1-4f0c-b670-0789417f4003 req-a9bd3545-66c5-46bc-b540-fc34f9a083b4 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:07:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-d13b1db6-79a1-4f0c-b670-0789417f4003 req-a9bd3545-66c5-46bc-b540-fc34f9a083b4 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:07:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-d13b1db6-79a1-4f0c-b670-0789417f4003 req-a9bd3545-66c5-46bc-b540-fc34f9a083b4 tempest-AttachVolumeTestJSON-1776661476 None] Terminate volume connection completed successfully.
Sep 23 15:07:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-d13b1db6-79a1-4f0c-b670-0789417f4003 req-a9bd3545-66c5-46bc-b540-fc34f9a083b4 tempest-AttachVolumeTestJSON-1776661476 None] Deleting attachment eaa8020d-264d-47a8-86cc-39ad772e022e. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:07:26 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:07:41 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Flow 'volume_create_manager' (018adbe4-5504-4f4a-82f8-efb595b77859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00156042-54c0-4eda-b94c-84967dc1601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00156042-54c0-4eda-b94c-84967dc1601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-968872406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbb8841-846d-4464-ad43-1ee4beeceafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d58cceab1cc44c0963f2d127ca931f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:07:41Z,use_quota=True,user_id='c148f12502e04936b8b0d1ee3fc2c76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcb092b-97f4-4c92-ab36-808ba21d79b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcb092b-97f4-4c92-ab36-808ba21d79b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8fe32e-77a7-457f-9697-d2376c72207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8fe32e-77a7-457f-9697-d2376c72207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbb8841-846d-4464-ad43-1ee4beeceafd', 'volume_name': 'volume-9cbb8841-846d-4464-ad43-1ee4beeceafd', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60ad92-027e-43ef-9e65-b6a6b29c50cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60ad92-027e-43ef-9e65-b6a6b29c50cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebdc6c3-0dc4-44a3-a876-76c51fbeb7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:07:41 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Volume 9cbb8841-846d-4464-ad43-1ee4beeceafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbb8841-846d-4464-ad43-1ee4beeceafd', 'volume_size': 1}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-968872406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbb8841-846d-4464-ad43-1ee4beeceafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d58cceab1cc44c0963f2d127ca931f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:07:41Z,use_quota=True,user_id='c148f12502e04936b8b0d1ee3fc2c76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Creating volume 9cbb8841-846d-4464-ad43-1ee4beeceafd {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:07:41 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:07:41 devstack quobyte-client[84024]: System call of process 88934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:07:41 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=9, name=volume-9cbb8841-846d-4464-ad43-1ee4beeceafd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd 1073741824" returned: 0 in 0.577s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:07:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:07:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd" returned: 0 in 0.665s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:07:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] <== create_volume: return (1372ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:07:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:07:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebdc6c3-0dc4-44a3-a876-76c51fbeb7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbb8841-846d-4464-ad43-1ee4beeceafd', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:07:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884ab883-e226-43c9-837c-05fdcb375159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:07:43 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Volume volume-9cbb8841-846d-4464-ad43-1ee4beeceafd (9cbb8841-846d-4464-ad43-1ee4beeceafd): created successfully
Sep 23 15:07:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884ab883-e226-43c9-837c-05fdcb375159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:07:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Flow 'volume_create_manager' (018adbe4-5504-4f4a-82f8-efb595b77859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:07:43 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-edc05583-8446-4fed-a8c2-30085ebddfcf tempest-TaggedAttachmentsTest-419327627 None] Created volume successfully.
Sep 23 15:07:53 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:07:53 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:08:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:08:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:08:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "cinder-ed5682d3-7215-4402-8211-c997c81d949a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:08:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-ed5682d3-7215-4402-8211-c997c81d949a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:08:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:08:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "cinder-quobyte-ed5682d3-7215-4402-8211-c997c81d949a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:08:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-quobyte-ed5682d3-7215-4402-8211-c997c81d949a" acquired by "delete_volume" :: waited 0.025s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:08:55 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874067d-99b7-4457-87bb-e897a4c2b95d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:08:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:08:56 devstack quobyte-client[84024]: System call of process 89319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:08:56 devstack quobyte-client[84024]: System call of process 89319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:08:56 devstack quobyte-client[84024]: System call of process 89319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:08:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a" returned: 0 in 1.207s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:08:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:08:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed5682d3-7215-4402-8211-c997c81d949a" returned: 0 in 0.423s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:08:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-quobyte-ed5682d3-7215-4402-8211-c997c81d949a" released by "delete_volume" :: held 2.058s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:08:57 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Created reservations ['fccf3e94-e94c-43e9-bf33-5a2662ce78f4', '6db05f96-2e6f-4b05-a7e9-439d31128e6a', '1d5fbf06-dbf3-489e-9b8c-c752ee9775f4', 'cd28deb5-041d-4cd6-9071-600585e2849b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.189s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:08:58 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:08:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Deleted volume successfully.
Sep 23 15:08:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-59de52ee-c052-40a9-b182-73686a7c140b tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-ed5682d3-7215-4402-8211-c997c81d949a-delete_volume" released by "delete_volume" :: held 3.836s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:09:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "cinder-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:09:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:09:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:09:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "cinder-quobyte-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:09:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-quobyte-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:09:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b3211-4ae0-453c-a5f9-664355f99793]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:09:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:09:02 devstack quobyte-client[84024]: System call of process 89375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:09:02 devstack quobyte-client[84024]: System call of process 89375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:09:02 devstack quobyte-client[84024]: System call of process 89375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:09:02 devstack quobyte-client[84024]: System call of process 89375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:09:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" returned: 0 in 1.187s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:09:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:09:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" returned: 0 in 0.176s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:09:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-quobyte-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2" released by "delete_volume" :: held 1.617s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Created reservations ['ac87fc2b-309f-4e3c-b72a-9656a2a50fc3', 'bcc486be-d815-4b28-b213-a93057296db4', 'c9901b72-009c-4e78-b420-f3755fe7ef6f', '971354f8-decf-436c-a23c-7367166dcc66'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:09:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:09:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.261s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:09:04 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:09:04 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Deleted volume successfully.
Sep 23 15:09:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5eab6c45-32d6-402d-89d7-877ff49b9d61 tempest-AttachVolumeShelveTestJSON-1776733145 None] Lock "cinder-4d9650d2-bb7c-4dd7-81e1-97bcb1e56dd2-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.193s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:09:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:09:13 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=21,cinder:SELECT=7,cinder:INSERT=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:09:14 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:09:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:09:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:09:53 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5f398-444d-4b4e-997d-42c730513fd8]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:09:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:09:54 devstack quobyte-client[84024]: System call of process 89578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:09:54 devstack quobyte-client[84024]: System call of process 89578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:09:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd" returned: 0 in 1.275s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:09:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.382s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:09:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-9cbb8841-846d-4464-ad43-1ee4beeceafd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be86f2b2-dc71-4553-971e-65fb11a2a9e5', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:09:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:09:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-5c12015f-eecc-4f80-a1d2-9065a5b4a3e7 req-c77a60f8-9193-49c1-b718-71193d16e990 tempest-TaggedAttachmentsTest-419327627 None] attachment_update completed successfully.
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.314s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:10:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:10:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:10:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:10:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-57669230-e108-439a-973c-388d74407b52 req-1bd0bd99-103e-481a-a6c0-83763ecbd40e tempest-TaggedAttachmentsTest-419327627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:10:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-57669230-e108-439a-973c-388d74407b52 req-1bd0bd99-103e-481a-a6c0-83763ecbd40e tempest-TaggedAttachmentsTest-419327627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:10:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-57669230-e108-439a-973c-388d74407b52 req-1bd0bd99-103e-481a-a6c0-83763ecbd40e tempest-TaggedAttachmentsTest-419327627 None] Terminate volume connection completed successfully.
Sep 23 15:10:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-57669230-e108-439a-973c-388d74407b52 req-1bd0bd99-103e-481a-a6c0-83763ecbd40e tempest-TaggedAttachmentsTest-419327627 None] Deleting attachment be86f2b2-dc71-4553-971e-65fb11a2a9e5. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:10:40 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:10:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Flow 'volume_create_manager' (dda32e6f-6f62-4d54-9f2d-0fe4d5126ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5548c40c-aa4f-44d4-b5e0-fda037123448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5548c40c-aa4f-44d4-b5e0-fda037123448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-796818016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb19b57-0818-4fa5-894e-f0367bb62ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8afbb22defc4d879f0f9988ebb83d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:10:58Z,use_quota=True,user_id='dfa34df99b9c4ca08544f083188efc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473a46da-c7cb-4a01-adca-115ee51154c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473a46da-c7cb-4a01-adca-115ee51154c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7d2cfd-3e3c-4011-9e18-c0f0172fab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7d2cfd-3e3c-4011-9e18-c0f0172fab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb19b57-0818-4fa5-894e-f0367bb62ac5', 'volume_name': 'volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd58ecba-78c4-4fe6-9546-d5bf3d8e9ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd58ecba-78c4-4fe6-9546-d5bf3d8e9ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e2b4fe-9535-4671-b627-4a564db31180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:10:59 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Volume eeb19b57-0818-4fa5-894e-f0367bb62ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5', 'volume_size': 1}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-796818016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb19b57-0818-4fa5-894e-f0367bb62ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8afbb22defc4d879f0f9988ebb83d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:10:58Z,use_quota=True,user_id='dfa34df99b9c4ca08544f083188efc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Creating volume eeb19b57-0818-4fa5-894e-f0367bb62ac5 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:10:59 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:10:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:10:59 devstack quobyte-client[84024]: System call of process 90254 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:10:59 devstack quobyte-client[84024]: System call of process 90254 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:10:59 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=10, name=volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 1073741824" returned: 0 in 0.667s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5" returned: 0 in 0.228s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] <== create_volume: return (1013ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e2b4fe-9535-4671-b627-4a564db31180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90a6f19-f186-419a-b435-227ecd013b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:00 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Volume volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 (eeb19b57-0818-4fa5-894e-f0367bb62ac5): created successfully
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90a6f19-f186-419a-b435-227ecd013b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Flow 'volume_create_manager' (dda32e6f-6f62-4d54-9f2d-0fe4d5126ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:11:00 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f93c9a82-6e50-4f53-b3d3-fd5a172013bc tempest-AttachVolumeTestJSON-1776661476 None] Created volume successfully.
Sep 23 15:11:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:06 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa61f02c-fdca-42fc-bc09-7a59307ce2bc]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:11:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:07 devstack quobyte-client[84024]: System call of process 90335 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:11:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5" returned: 0 in 0.711s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '059a2332-6264-47df-b369-57fdd106b5cc', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:11:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:07 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-b4df12c6-f59b-48b4-bc48-c1b531c85d9b req-e72529b9-da81-415d-80f0-5945ca56d1d1 tempest-AttachVolumeTestJSON-1776661476 None] attachment_update completed successfully.
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.139s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:11:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Acquiring lock "cinder-9cbb8841-846d-4464-ad43-1ee4beeceafd-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:11:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Lock "cinder-9cbb8841-846d-4464-ad43-1ee4beeceafd-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:11:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Acquiring lock "cinder-quobyte-9cbb8841-846d-4464-ad43-1ee4beeceafd" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:11:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Lock "cinder-quobyte-9cbb8841-846d-4464-ad43-1ee4beeceafd" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:11:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a013f-06cc-40f4-94e8-1819022d5e2a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:11:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd" returned: 0 in 0.484s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-9cbb8841-846d-4464-ad43-1ee4beeceafd" returned: 0 in 0.240s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Lock "cinder-quobyte-9cbb8841-846d-4464-ad43-1ee4beeceafd" released by "delete_volume" :: held 1.005s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:11:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Flow 'volume_create_manager' (98e66efc-8c5c-41b4-8ee6-b5e166553ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d25606-150a-42b9-8542-bdb56bdee9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d25606-150a-42b9-8542-bdb56bdee9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1501722106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf3cc6e-befc-4655-92cd-3f2ec7ab32c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8afbb22defc4d879f0f9988ebb83d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:11:15Z,use_quota=True,user_id='dfa34df99b9c4ca08544f083188efc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457d6972-6ed3-406f-9058-936484639950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457d6972-6ed3-406f-9058-936484639950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0dc684-d463-432e-b075-eb7357a291cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0dc684-d463-432e-b075-eb7357a291cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf3cc6e-befc-4655-92cd-3f2ec7ab32c9', 'volume_name': 'volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dc15ea-50a0-4bd8-a579-911c184064a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dc15ea-50a0-4bd8-a579-911c184064a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6919dfd2-e987-4e99-b792-4501cf51214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Volume faf3cc6e-befc-4655-92cd-3f2ec7ab32c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9', 'volume_size': 1}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1501722106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf3cc6e-befc-4655-92cd-3f2ec7ab32c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8afbb22defc4d879f0f9988ebb83d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:11:15Z,use_quota=True,user_id='dfa34df99b9c4ca08544f083188efc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Creating volume faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:11:15 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:15 devstack quobyte-client[84024]: System call of process 90734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:11:15 devstack quobyte-client[84024]: System call of process 90734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Created reservations ['b26014bf-6909-4897-8045-fe6ecb854c5e', '30722a5d-460e-4284-81c0-3c027da91b21', '40be7683-0253-40d6-80ff-e8095a6b04bf', 'd467b508-6e11-4406-b53d-578b593eaf6b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:11:15 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=11, name=volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:11:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 1073741824" returned: 0 in 0.546s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" returned: 0 in 0.373s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] <== create_volume: return (989ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.299s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6919dfd2-e987-4e99-b792-4501cf51214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266709dc-2e35-4c37-b251-3fdc8793fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Deleted volume successfully.
Sep 23 15:11:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Volume volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 (faf3cc6e-befc-4655-92cd-3f2ec7ab32c9): created successfully
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266709dc-2e35-4c37-b251-3fdc8793fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Flow 'volume_create_manager' (98e66efc-8c5c-41b4-8ee6-b5e166553ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:11:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2e052018-e920-47f5-9d5c-60e94feb21cd tempest-AttachVolumeTestJSON-1776661476 None] Created volume successfully.
Sep 23 15:11:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7606a863-3046-445c-b6d5-a7fee7cb8531 tempest-TaggedAttachmentsTest-419327627 None] Lock "cinder-9cbb8841-846d-4464-ad43-1ee4beeceafd-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:11:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Flow 'volume_create_manager' (4d7f22d7-f619-430e-a2ab-1a7b1a5e0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc31be-c843-4d06-81c8-b5a83554d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc31be-c843-4d06-81c8-b5a83554d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1596043076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68cebce-6e5c-4812-80d7-80e2d224336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8a1f61b064e41a9ed7263e4848527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:11:17Z,use_quota=True,user_id='37f3d124e7384eb08a5aac3dbbb24aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c193ffca-6fbd-4988-96ae-a5fc6f1e6bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c193ffca-6fbd-4988-96ae-a5fc6f1e6bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bd137b-e810-4249-b69b-afcffdb4c1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bd137b-e810-4249-b69b-afcffdb4c1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68cebce-6e5c-4812-80d7-80e2d224336b', 'volume_name': 'volume-f68cebce-6e5c-4812-80d7-80e2d224336b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0f4fd8-cecb-4862-bb9c-9b7e924f2f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0f4fd8-cecb-4862-bb9c-9b7e924f2f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af0f34e-677d-4188-b4c1-56370306a648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:17 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Volume f68cebce-6e5c-4812-80d7-80e2d224336b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68cebce-6e5c-4812-80d7-80e2d224336b', 'volume_size': 1}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1596043076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68cebce-6e5c-4812-80d7-80e2d224336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8a1f61b064e41a9ed7263e4848527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:11:17Z,use_quota=True,user_id='37f3d124e7384eb08a5aac3dbbb24aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Creating volume f68cebce-6e5c-4812-80d7-80e2d224336b {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:11:17 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:17 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=12, name=volume-f68cebce-6e5c-4812-80d7-80e2d224336b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b 1073741824" returned: 0 in 0.416s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b" returned: 0 in 0.114s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] <== create_volume: return (648ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:11:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af0f34e-677d-4188-b4c1-56370306a648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68cebce-6e5c-4812-80d7-80e2d224336b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725df3bb-6972-41ac-a0e6-7db1891993ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:11:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Volume volume-f68cebce-6e5c-4812-80d7-80e2d224336b (f68cebce-6e5c-4812-80d7-80e2d224336b): created successfully
Sep 23 15:11:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725df3bb-6972-41ac-a0e6-7db1891993ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:11:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Flow 'volume_create_manager' (4d7f22d7-f619-430e-a2ab-1a7b1a5e0937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:11:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-cfdcd662-46b9-4990-9908-f590149f5969 tempest-AttachVolumeNegativeTest-1403103512 None] Created volume successfully.
Sep 23 15:11:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[158a293b-ecf6-4b4f-b642-b94b5471396d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:11:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:24 devstack quobyte-client[84024]: System call of process 90775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:11:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" returned: 0 in 0.845s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.979s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:11:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:11:24 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[543cbd7e-0ef7-4c71-838c-898f37755d57]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:11:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:11:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc7ee418-9add-4434-be42-4a95f3fbcd17', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:11:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:25 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-df4fd56b-21d2-4905-8b6b-d473091119e0 req-7812d8c5-b6ed-4cba-9d6c-e0a2217b8e33 tempest-AttachVolumeTestJSON-1776661476 None] attachment_update completed successfully.
Sep 23 15:11:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b" returned: 0 in 0.986s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:11:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.070s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:11:26 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-f68cebce-6e5c-4812-80d7-80e2d224336b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54943a8d-768e-4403-b397-93b290eb0546', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:11:26 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:26 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-68cc4226-e64e-481a-a693-c4d753209bce req-9958c48b-1d55-4914-a230-0cf25bb73faa tempest-AttachVolumeNegativeTest-1403103512 None] attachment_update completed successfully.
Sep 23 15:11:36 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=27,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:11:36 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=28,cinder:DELETE=2,cinder:SELECT=22,cinder:INSERT=4 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:11:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-b29c0942-6207-4fb3-a67e-56c6112ee883 req-24f641d0-b89c-4134-bb5c-8c8e874c8f2f tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-b29c0942-6207-4fb3-a67e-56c6112ee883 req-24f641d0-b89c-4134-bb5c-8c8e874c8f2f tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:11:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-b29c0942-6207-4fb3-a67e-56c6112ee883 req-24f641d0-b89c-4134-bb5c-8c8e874c8f2f tempest-AttachVolumeTestJSON-1776661476 None] Terminate volume connection completed successfully.
Sep 23 15:11:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-b29c0942-6207-4fb3-a67e-56c6112ee883 req-24f641d0-b89c-4134-bb5c-8c8e874c8f2f tempest-AttachVolumeTestJSON-1776661476 None] Deleting attachment 059a2332-6264-47df-b369-57fdd106b5cc. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:12:03 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Flow 'volume_create_manager' (27451a91-b560-4802-8bd2-c8482f58611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e247e305-d44c-4d06-b6ca-f8c441ef6e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e247e305-d44c-4d06-b6ca-f8c441ef6e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-471611993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda91cb6-a916-43bd-af93-ca742604c675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c813e9b994d948f25862e6c27c610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:12:03Z,use_quota=True,user_id='3d4335054b21420f8d030ad685969e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eced927c-0f16-42dd-aa2e-f48e4bcfed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eced927c-0f16-42dd-aa2e-f48e4bcfed1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7586b526-fc89-4a6e-a461-348ae8ff3825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:03 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7586b526-fc89-4a6e-a461-348ae8ff3825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bda91cb6-a916-43bd-af93-ca742604c675', 'volume_name': 'volume-bda91cb6-a916-43bd-af93-ca742604c675', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97289ff550>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388d01ea-11b8-43f3-a624-07d759000937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388d01ea-11b8-43f3-a624-07d759000937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8716dfad-24e8-46ab-bd17-10432ac5dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:04 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Volume bda91cb6-a916-43bd-af93-ca742604c675: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bda91cb6-a916-43bd-af93-ca742604c675', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97289ff550>}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Cloning bda91cb6-a916-43bd-af93-ca742604c675 from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:12:04 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449a4dd-d2dc-44b7-80d1-39ee719a8ba9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:05 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD
Sep 23 15:12:05 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:12:07 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD" returned: 0 in 3.075s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 is fetched for user 3d4335054b21420f8d030ad685969e3f. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.428s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:12:09 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b8472-c682-47ab-a87c-35cd15b94670]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:09 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD
Sep 23 15:12:09 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:12:11 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD" returned: 0 in 2.215s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-471611993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda91cb6-a916-43bd-af93-ca742604c675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c813e9b994d948f25862e6c27c610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:12:03Z,use_quota=True,user_id='3d4335054b21420f8d030ad685969e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Creating volume bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:12:11 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:11 devstack quobyte-client[84024]: System call of process 91002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:11 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=13, name=volume-bda91cb6-a916-43bd-af93-ca742604c675, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 1073741824" returned: 0 in 0.379s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 0 in 0.082s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] <== create_volume: return (545ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:12:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.576s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Attempting download of 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume bda91cb6-a916-43bd-af93-ca742604c675. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[721bdebd-d4b9-474c-8bc4-f0a8f5b43d75]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_g8fec6nx {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_g8fec6nx" returned: 0 in 0.343s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_g8fec6nx {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_g8fec6nx" returned: 1 in 0.366s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_g8fec6nx' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd57b81-3833-42e0-ab46-a9e239281886]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:13 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] 26f34a6e-cf6d-4d01-b96a-d62e819357f3 was qcow2, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:12:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:13 devstack quobyte-client[84024]: System call of process 91013 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=13, name=volume-bda91cb6-a916-43bd-af93-ca742604c675, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:12:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 0 in 1.268s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:14 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_zg0xhehadevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:12:14 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Converted 112.00 MB image at 84.37 MB/s
Sep 23 15:12:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:14 devstack quobyte-client[84024]: System call of process 91020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:14 devstack quobyte-client[84024]: System call of process 91020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:14 devstack quobyte-client[84024]: System call of process 91020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 1G" returned: 0 in 0.178s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00e428e-9408-498d-b526-c7ddb378230d]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 0 in 0.468s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:16 devstack quobyte-client[84024]: System call of process 91025 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 1 in 0.431s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Downloaded image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume bda91cb6-a916-43bd-af93-ca742604c675 successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 for user 3d4335054b21420f8d030ad685969e3f is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Marking volume bda91cb6-a916-43bd-af93-ca742604c675 as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Copying metadata from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 to bda91cb6-a916-43bd-af93-ca742604c675. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Creating volume glance metadata for volume bda91cb6-a916-43bd-af93-ca742604c675 backed by image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8716dfad-24e8-46ab-bd17-10432ac5dd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda91cb6-a916-43bd-af93-ca742604c675', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f97289ff550>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79afdb0-d7f3-42b1-9dbc-04547e723d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Volume volume-bda91cb6-a916-43bd-af93-ca742604c675 (bda91cb6-a916-43bd-af93-ca742604c675): created successfully
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79afdb0-d7f3-42b1-9dbc-04547e723d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Flow 'volume_create_manager' (27451a91-b560-4802-8bd2-c8482f58611a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:12:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e1684578-77c9-4b43-925c-423544bba9f0 tempest-TaggedBootDevicesTest-528340984 None] Created volume successfully.
Sep 23 15:12:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Flow 'volume_create_manager' (c35942eb-21c8-4b75-a3d8-ac271f360960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60008d8-c0a9-4c69-8ebd-23790b97abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60008d8-c0a9-4c69-8ebd-23790b97abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1753332514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba29c62-2144-46a3-9231-84c13517b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c813e9b994d948f25862e6c27c610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:12:17Z,use_quota=True,user_id='3d4335054b21420f8d030ad685969e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4207eb1-bcd9-4de6-9f82-4eb89d243f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4207eb1-bcd9-4de6-9f82-4eb89d243f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f85883-4ad8-436c-a00b-4e4cd1b75f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f85883-4ad8-436c-a00b-4e4cd1b75f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba29c62-2144-46a3-9231-84c13517b6d6', 'volume_name': 'volume-bba29c62-2144-46a3-9231-84c13517b6d6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b50b4-0bd9-49df-abf6-0da2d7257757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b50b4-0bd9-49df-abf6-0da2d7257757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede7efe1-d84f-42bc-a1c1-2c45db7cd679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:17 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Volume bba29c62-2144-46a3-9231-84c13517b6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba29c62-2144-46a3-9231-84c13517b6d6', 'volume_size': 1}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1753332514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba29c62-2144-46a3-9231-84c13517b6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c813e9b994d948f25862e6c27c610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:12:17Z,use_quota=True,user_id='3d4335054b21420f8d030ad685969e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Creating volume bba29c62-2144-46a3-9231-84c13517b6d6 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:12:17 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:17 devstack quobyte-client[84024]: System call of process 91028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:17 devstack quobyte-client[84024]: System call of process 91028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:17 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=14, name=volume-bba29c62-2144-46a3-9231-84c13517b6d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6 1073741824" returned: 0 in 0.411s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6" returned: 0 in 0.123s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] <== create_volume: return (606ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:12:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede7efe1-d84f-42bc-a1c1-2c45db7cd679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba29c62-2144-46a3-9231-84c13517b6d6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf6cb4f-c989-4582-b980-a4b1a2db91dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Volume volume-bba29c62-2144-46a3-9231-84c13517b6d6 (bba29c62-2144-46a3-9231-84c13517b6d6): created successfully
Sep 23 15:12:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf6cb4f-c989-4582-b980-a4b1a2db91dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Flow 'volume_create_manager' (c35942eb-21c8-4b75-a3d8-ac271f360960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:12:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-feaf41e0-c29d-436b-bc43-c0a0dfdd1b28 tempest-TaggedBootDevicesTest-528340984 None] Created volume successfully.
Sep 23 15:12:19 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Flow 'volume_create_manager' (575c47b5-8474-4b51-8f1f-04311e1cf2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a316d0e-7918-476a-ac9c-97fc560b9958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a316d0e-7918-476a-ac9c-97fc560b9958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1623466691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fb63d0-252f-409c-8a31-0b4b4d1d5354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c813e9b994d948f25862e6c27c610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:12:20Z,use_quota=True,user_id='3d4335054b21420f8d030ad685969e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f9425d-e64d-499d-922f-47689803acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f9425d-e64d-499d-922f-47689803acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a73aad8-1479-45eb-bf24-134fde478823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a73aad8-1479-45eb-bf24-134fde478823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fb63d0-252f-409c-8a31-0b4b4d1d5354', 'volume_name': 'volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b992564-2c6a-425f-8e6e-05d0dcc3befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b992564-2c6a-425f-8e6e-05d0dcc3befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844dce40-1520-4c53-8355-4d0d9b70fa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:19 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Volume b0fb63d0-252f-409c-8a31-0b4b4d1d5354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354', 'volume_size': 1}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1623466691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fb63d0-252f-409c-8a31-0b4b4d1d5354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306c813e9b994d948f25862e6c27c610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:12:20Z,use_quota=True,user_id='3d4335054b21420f8d030ad685969e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Creating volume b0fb63d0-252f-409c-8a31-0b4b4d1d5354 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:12:19 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:20 devstack quobyte-client[84024]: System call of process 91033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:20 devstack quobyte-client[84024]: System call of process 91033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:20 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=15, name=volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:12:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-ecec91dc-990b-403b-9fef-5b64bfd58bd6 req-e846608a-2d20-4d4b-b646-b7bb7cec5a1e tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 1073741824" returned: 0 in 0.659s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-ecec91dc-990b-403b-9fef-5b64bfd58bd6 req-e846608a-2d20-4d4b-b646-b7bb7cec5a1e tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:20 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-ecec91dc-990b-403b-9fef-5b64bfd58bd6 req-e846608a-2d20-4d4b-b646-b7bb7cec5a1e tempest-AttachVolumeTestJSON-1776661476 None] Terminate volume connection completed successfully.
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ecec91dc-990b-403b-9fef-5b64bfd58bd6 req-e846608a-2d20-4d4b-b646-b7bb7cec5a1e tempest-AttachVolumeTestJSON-1776661476 None] Deleting attachment cc7ee418-9add-4434-be42-4a95f3fbcd17. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" returned: 0 in 0.309s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] <== create_volume: return (994ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:12:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844dce40-1520-4c53-8355-4d0d9b70fa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f59da-ebd2-47aa-a091-3a95765c640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:12:21 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Volume volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 (b0fb63d0-252f-409c-8a31-0b4b4d1d5354): created successfully
Sep 23 15:12:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f59da-ebd2-47aa-a091-3a95765c640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:12:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Flow 'volume_create_manager' (575c47b5-8474-4b51-8f1f-04311e1cf2cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:12:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-12aa9b3c-7437-45be-ae9b-702d30369e59 tempest-TaggedBootDevicesTest-528340984 None] Created volume successfully.
Sep 23 15:12:31 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:12:31 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=12,cinder:INSERT=10,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:12:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "cinder-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:12:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:12:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "cinder-quobyte-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:12:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-quobyte-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" acquired by "delete_volume" :: waited 0.019s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:12:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[683c9ef1-3eb9-4e43-a9d1-b7635a7af736]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" returned: 0 in 0.597s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" returned: 0 in 0.142s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-quobyte-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9" released by "delete_volume" :: held 0.978s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Created reservations ['bf64effe-b3a2-4bc5-9518-7bed4b5afd33', 'c8dcd740-ef76-4901-bdb7-6ad5927f4142', 'f1176783-e74b-4473-8c6e-d3f6241a42f7', '9b053539-7072-47f5-9172-956c420b49d2'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.117s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:12:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Deleted volume successfully.
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eecb0e11-c942-40de-a1c4-8b388b41187d tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-faf3cc6e-befc-4655-92cd-3f2ec7ab32c9-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "cinder-eeb19b57-0818-4fa5-894e-f0367bb62ac5-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-eeb19b57-0818-4fa5-894e-f0367bb62ac5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:12:41 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "cinder-quobyte-eeb19b57-0818-4fa5-894e-f0367bb62ac5" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-quobyte-eeb19b57-0818-4fa5-894e-f0367bb62ac5" acquired by "delete_volume" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4fbda4-d33e-4d8b-a2c6-30eb1f2d3012]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5" returned: 0 in 0.523s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-eeb19b57-0818-4fa5-894e-f0367bb62ac5" returned: 0 in 0.139s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-quobyte-eeb19b57-0818-4fa5-894e-f0367bb62ac5" released by "delete_volume" :: held 0.844s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Created reservations ['c13494c6-80c4-4d53-99af-426c9768cc1b', '94a3d11c-6cd8-46e9-9021-a29a12c479cc', '7c4022f6-5c3a-404d-924b-e547568ed14b', '8a71474b-02dc-4f1f-8221-5cc65bf6c5d5'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.106s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:12:43 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Deleted volume successfully.
Sep 23 15:12:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6f786203-5056-4e8a-b103-329c81dd47a1 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-eeb19b57-0818-4fa5-894e-f0367bb62ac5-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:12:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "cinder-ae4b01b8-99c0-4d82-af89-cceaba24cf28-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:12:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-ae4b01b8-99c0-4d82-af89-cceaba24cf28-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:12:44 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "cinder-quobyte-ae4b01b8-99c0-4d82-af89-cceaba24cf28" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:12:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-quobyte-ae4b01b8-99c0-4d82-af89-cceaba24cf28" acquired by "delete_volume" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:12:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[41972b7c-2ff3-4c3d-9e9a-6c59ca71e8a0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28" returned: 0 in 0.532s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ae4b01b8-99c0-4d82-af89-cceaba24cf28" returned: 0 in 0.127s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-quobyte-ae4b01b8-99c0-4d82-af89-cceaba24cf28" released by "delete_volume" :: held 0.861s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:12:45 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Created reservations ['456a6ef7-73ee-4337-ab53-c5821f9c0aaa', '56d6d94a-5d2e-4581-9de5-2233bebc5cf0', '65ea2964-2e5b-436a-a4a8-c446d23f2b2c', '5d49515a-6d01-46ac-989f-9497bb666a93'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.084s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:12:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Deleted volume successfully.
Sep 23 15:12:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-798efba2-d3ac-41b0-9d7d-40e8eec6b9c3 tempest-AttachVolumeTestJSON-1776661476 None] Lock "cinder-ae4b01b8-99c0-4d82-af89-cceaba24cf28-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:12:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:12:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:12:54 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1c4bb0-76dc-46b3-b744-5faf5398216f]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:12:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:55 devstack quobyte-client[84024]: System call of process 91156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 0 in 0.625s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:12:56 devstack quobyte-client[84024]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:56 devstack quobyte-client[84024]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:12:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 1 in 0.674s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:12:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:12:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.476s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:12:56 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=30,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:12:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-bda91cb6-a916-43bd-af93-ca742604c675', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a69bb67-0e5c-4018-9772-308d4f956296', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:12:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:12:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-26b50bff-4a20-45f2-91d8-ff3877f5dc7d tempest-TaggedBootDevicesTest-528340984 None] attachment_update completed successfully.
Sep 23 15:13:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c6539-c6d5-4a26-8d30-c1fad76d7d57]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6" returned: 0 in 0.963s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.077s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-bba29c62-2144-46a3-9231-84c13517b6d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a69bb95f-86b4-457b-953b-451d21e5ccb4', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:13:03 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:03 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-85c20d98-84a2-4d8e-99cc-f8c3a6fb7d95 tempest-TaggedBootDevicesTest-528340984 None] attachment_update completed successfully.
Sep 23 15:13:05 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7e216f88-5139-4f36-a823-a823a5f890a2 tempest-GroupSnapshotsV319Test-1431217691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e216f88-5139-4f36-a823-a823a5f890a2 tempest-GroupSnapshotsV319Test-1431217691 None] Group tempest-GroupSnapshotsV319Test-Group-901749388: creating
Sep 23 15:13:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e216f88-5139-4f36-a823-a823a5f890a2 tempest-GroupSnapshotsV319Test-1431217691 None] Group tempest-GroupSnapshotsV319Test-Group-901749388: created successfully
Sep 23 15:13:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e216f88-5139-4f36-a823-a823a5f890a2 tempest-GroupSnapshotsV319Test-1431217691 None] Create group completed successfully.
Sep 23 15:13:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:06 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba4f21-5ed9-4fa7-a990-96e6a98e74b4]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:07 devstack quobyte-client[84024]: System call of process 91230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" returned: 0 in 1.406s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.481s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Flow 'volume_create_manager' (d89682e0-5baa-48b5-89f5-b16b6c893ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965326ec-0bbf-45b3-a57b-b2b4fa4b29ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965326ec-0bbf-45b3-a57b-b2b4fa4b29ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171425725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f2a2dc3b-d375-4546-bd74-9a12039ba968,host='devstack@QuobyteHD#QuobyteHD',id=0250772f-3313-4534-b559-372d200563e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cfa89d13da4259ab046a8309c0f8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:13:07Z,use_quota=True,user_id='a134a397ce5348c589ffbb38b638e10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcf5a12-c54c-409a-8348-3b5e5b38386d),volume_type_id=8bcf5a12-c54c-409a-8348-3b5e5b38386d)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7faa7c4-ef0d-490a-abcc-2ffa2cef38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7faa7c4-ef0d-490a-abcc-2ffa2cef38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbcbeca-d321-42b1-94fd-5c800b5ec9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbcbeca-d321-42b1-94fd-5c800b5ec9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0250772f-3313-4534-b559-372d200563e5', 'volume_name': 'volume-0250772f-3313-4534-b559-372d200563e5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eaff2ef-4e7f-4a22-8ef6-024e4d612347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eaff2ef-4e7f-4a22-8ef6-024e4d612347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0e23f2-b2ae-44ca-a006-124071480066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Volume 0250772f-3313-4534-b559-372d200563e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0250772f-3313-4534-b559-372d200563e5', 'volume_size': 1}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f2a2dc3b-d375-4546-bd74-9a12039ba968,created_at=2025-09-23T13:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171425725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f2a2dc3b-d375-4546-bd74-9a12039ba968,host='devstack@QuobyteHD#QuobyteHD',id=0250772f-3313-4534-b559-372d200563e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83cfa89d13da4259ab046a8309c0f8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:13:07Z,use_quota=True,user_id='a134a397ce5348c589ffbb38b638e10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcf5a12-c54c-409a-8348-3b5e5b38386d),volume_type_id=8bcf5a12-c54c-409a-8348-3b5e5b38386d)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Creating volume 0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:13:08 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:08 devstack quobyte-client[84024]: System call of process 91233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:08 devstack quobyte-client[84024]: System call of process 91233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:08 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=16, name=volume-0250772f-3313-4534-b559-372d200563e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b99ae31-e747-4554-a3e6-376a86bedfd1', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:13:09 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 1073741824" returned: 0 in 1.734s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 1.843s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5" returned: 0 in 0.846s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] <== create_volume: return (2639ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:13:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:11 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-fb28c9a6-1fd1-44d1-abd7-cbb691d18551 req-e377a220-0510-4547-877b-7d43478f6d0b tempest-TaggedBootDevicesTest-528340984 None] attachment_update completed successfully.
Sep 23 15:13:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0e23f2-b2ae-44ca-a006-124071480066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0250772f-3313-4534-b559-372d200563e5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923bdee5-75b1-44bc-81a7-2c191c265c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Volume volume-0250772f-3313-4534-b559-372d200563e5 (0250772f-3313-4534-b559-372d200563e5): created successfully
Sep 23 15:13:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923bdee5-75b1-44bc-81a7-2c191c265c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Flow 'volume_create_manager' (d89682e0-5baa-48b5-89f5-b16b6c893ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:13:11 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-85bbe7d5-0bc1-4676-a5d0-03d0d2baea0a tempest-GroupSnapshotsV319Test-1431217691 None] Created volume successfully.
Sep 23 15:13:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] GroupSnapshot 21545fdf-bb02-4d79-ae32-6ebedf1bc9cd: creating.
Sep 23 15:13:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Group snapshot 21545fdf-bb02-4d79-ae32-6ebedf1bc9cd: creating. {{(pid=84009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 23 15:13:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Creating offline snapshot 736250b5-7155-4412-a6df-6df321a2363b of volume 0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:13:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[630238f7-20b4-4814-917a-213f88d24881]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:14 devstack quobyte-client[84024]: System call of process 91284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:14 devstack quobyte-client[84024]: System call of process 91284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5" returned: 0 in 0.583s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:14 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=17, name=volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:13:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b 1G" returned: 0 in 0.269s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0250772f-3313-4534-b559-372d200563e5 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:14 devstack quobyte-client[84024]: System call of process 91292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:14 devstack quobyte-client[84024]: System call of process 91292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:14 devstack quobyte-client[84024]: System call of process 91292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:14 devstack quobyte-client[84024]: System call of process 91292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "qemu-img rebase -u -b volume-0250772f-3313-4534-b559-372d200563e5 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b" returned: 0 in 0.169s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b" returned: 0 in 0.207s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b" returned: 0 in 0.290s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.info" returned: 0 in 0.222s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:13:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.info" returned: 0 in 0.230s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7a757e90-e899-4b85-9000-45a2ad03a25c tempest-GroupSnapshotsV319Test-1431217691 None] group_snapshot 21545fdf-bb02-4d79-ae32-6ebedf1bc9cd: created successfully
Sep 23 15:13:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] group_snapshot 21545fdf-bb02-4d79-ae32-6ebedf1bc9cd: deleting
Sep 23 15:13:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] group_snapshot 21545fdf-bb02-4d79-ae32-6ebedf1bc9cd: deleting {{(pid=84009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "cinder-quobyte-0250772f-3313-4534-b559-372d200563e5" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Lock "cinder-quobyte-0250772f-3313-4534-b559-372d200563e5" acquired by "delete_snapshot" :: waited 0.047s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "cinder-quobyte-736250b5-7155-4412-a6df-6df321a2363b" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Lock "cinder-quobyte-736250b5-7155-4412-a6df-6df321a2363b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Deleting offline snapshot 736250b5-7155-4412-a6df-6df321a2363b of volume 0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] snapshot_file for this snap is: volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eb12aa-a71e-45e2-ba49-15a02b58f807]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:20 devstack quobyte-client[84024]: System call of process 91303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b" returned: 0 in 0.851s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0250772f-3313-4534-b559-372d200563e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:13:20 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[214322bd-0f61-4fda-bc8b-05add3c55275]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5" returned: 0 in 0.537s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:21 devstack quobyte-client[84024]: System call of process 91309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b" returned: 0 in 0.403s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5.736250b5-7155-4412-a6df-6df321a2363b" returned: 0 in 0.172s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Lock "cinder-quobyte-736250b5-7155-4412-a6df-6df321a2363b" released by "_delete_snapshot" :: held 2.378s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:13:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Lock "cinder-quobyte-0250772f-3313-4534-b559-372d200563e5" released by "delete_snapshot" :: held 2.425s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:13:21 devstack cinder-volume[84009]: WARNING cinder.quota [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1528577300 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1528577300, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:13:21 devstack cinder-volume[84009]: WARNING cinder.quota [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1528577300 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1528577300, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:13:22 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] Created reservations ['6c0be810-ad7c-4125-b0e3-5823be379061', '15830929-f055-4e31-bc32-eeb98ccbf459', '11a8df27-e259-4608-9437-36470ed49eaf', '98eb6d14-4104-4f1b-8812-acd85f7382e5'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:13:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-94895e6e-f8c6-4ea4-a4ed-c0263220db2f tempest-GroupSnapshotsV319Test-1431217691 None] group_snapshot 21545fdf-bb02-4d79-ae32-6ebedf1bc9cd: deleted successfully
Sep 23 15:13:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "cinder-quobyte-0250772f-3313-4534-b559-372d200563e5" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:13:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Lock "cinder-quobyte-0250772f-3313-4534-b559-372d200563e5" acquired by "delete_volume" :: waited 0.036s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:13:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b417e6c-9fa6-4b82-bf7a-f8bdf16bd6cf]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:24 devstack quobyte-client[84024]: System call of process 91319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:24 devstack quobyte-client[84024]: System call of process 91319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:24 devstack quobyte-client[84024]: System call of process 91319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5" returned: 0 in 0.949s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0250772f-3313-4534-b559-372d200563e5" returned: 0 in 0.173s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Lock "cinder-quobyte-0250772f-3313-4534-b559-372d200563e5" released by "delete_volume" :: held 1.390s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:13:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Created reservations ['7a7d7737-03fd-4ce0-88e6-f112ab613c9a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:13:25 devstack cinder-volume[84009]: WARNING cinder.quota [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1528577300 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1528577300, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Created reservations ['14d6f83b-e68c-47f2-b0dd-9af1159bd9c7', '4cfd4a69-66de-4f4c-9d6f-04f11be599e1', '68b871e7-d701-4cdc-9d5d-d90d239d40d5', 'f0330002-a028-4217-9477-bfe9c80d4a9c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.192s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:26 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:13:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-896a0c81-e91e-4362-b89b-afc52b30281c tempest-GroupSnapshotsV319Test-1431217691 None] Delete group completed successfully.
Sep 23 15:13:36 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=51,cinder:UPDATE=38,cinder:DELETE=1,cinder:INSERT=13 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:13:36 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=43,cinder:UPDATE=32,cinder:DELETE=1,cinder:INSERT=4 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:13:40 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-46a58a88-6359-4a5a-b4db-86c30447e883 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:40 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-46a58a88-6359-4a5a-b4db-86c30447e883 tempest-GroupsTest-1962535541 None] Group tempest-Group1-302487382: creating
Sep 23 15:13:40 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-46a58a88-6359-4a5a-b4db-86c30447e883 tempest-GroupsTest-1962535541 None] Group tempest-Group1-302487382: created successfully
Sep 23 15:13:40 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-46a58a88-6359-4a5a-b4db-86c30447e883 tempest-GroupsTest-1962535541 None] Create group completed successfully.
Sep 23 15:13:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-48bfb2f8-aa9d-4ba6-9530-5c131469a0fb tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-48bfb2f8-aa9d-4ba6-9530-5c131469a0fb tempest-GroupsTest-1962535541 None] Group tempest-Group2-90282053: creating
Sep 23 15:13:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-48bfb2f8-aa9d-4ba6-9530-5c131469a0fb tempest-GroupsTest-1962535541 None] Group tempest-Group2-90282053: created successfully
Sep 23 15:13:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-48bfb2f8-aa9d-4ba6-9530-5c131469a0fb tempest-GroupsTest-1962535541 None] Create group completed successfully.
Sep 23 15:13:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Flow 'volume_create_manager' (7816f564-aadd-4c2d-8462-766d104f3ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0554f65-9e41-40bc-ba60-ac65f8d610bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0554f65-9e41-40bc-ba60-ac65f8d610bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958416520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=465d48f9-48ef-4a4b-aa77-272ba6d5cf16,host='devstack@QuobyteHD#QuobyteHD',id=c02fb900-1c99-47ff-a2c9-db543152a328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232589a76a54e92afac6dfe5bb5a189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:13:45Z,use_quota=True,user_id='ca48dbee25f34faeaf8dc0f8a9f4d07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(803f8e6f-e4a2-41d9-b6a7-4891353608cc),volume_type_id=803f8e6f-e4a2-41d9-b6a7-4891353608cc)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac110bb-1a5d-4945-a7ec-18773f0dc80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac110bb-1a5d-4945-a7ec-18773f0dc80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88fd7b1-9265-459f-9791-32fc02b7058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88fd7b1-9265-459f-9791-32fc02b7058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02fb900-1c99-47ff-a2c9-db543152a328', 'volume_name': 'volume-c02fb900-1c99-47ff-a2c9-db543152a328', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965b18cd-7b9f-449f-af8d-93380bf881e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965b18cd-7b9f-449f-af8d-93380bf881e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13fad8f-0af7-4ae9-a3b7-845dea690344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:46 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Volume c02fb900-1c99-47ff-a2c9-db543152a328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02fb900-1c99-47ff-a2c9-db543152a328', 'volume_size': 1}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=465d48f9-48ef-4a4b-aa77-272ba6d5cf16,created_at=2025-09-23T13:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958416520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=465d48f9-48ef-4a4b-aa77-272ba6d5cf16,host='devstack@QuobyteHD#QuobyteHD',id=c02fb900-1c99-47ff-a2c9-db543152a328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232589a76a54e92afac6dfe5bb5a189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:13:45Z,use_quota=True,user_id='ca48dbee25f34faeaf8dc0f8a9f4d07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(803f8e6f-e4a2-41d9-b6a7-4891353608cc),volume_type_id=803f8e6f-e4a2-41d9-b6a7-4891353608cc)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Creating volume c02fb900-1c99-47ff-a2c9-db543152a328 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:13:46 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:13:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:46 devstack quobyte-client[84024]: System call of process 91690 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:46 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=19, name=volume-c02fb900-1c99-47ff-a2c9-db543152a328, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:13:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328 1073741824" returned: 0 in 1.014s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328" returned: 0 in 0.332s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] <== create_volume: return (1735ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:13:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-1a6afdb2-e3dc-4db6-8f30-769d44557e6f req-d00e28f0-a6db-4eb0-91e8-b84f6ad1bbdd tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13fad8f-0af7-4ae9-a3b7-845dea690344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02fb900-1c99-47ff-a2c9-db543152a328', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a365f233-6208-46f9-b009-c70c853a29d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:13:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Volume volume-c02fb900-1c99-47ff-a2c9-db543152a328 (c02fb900-1c99-47ff-a2c9-db543152a328): created successfully
Sep 23 15:13:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a365f233-6208-46f9-b009-c70c853a29d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:13:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Flow 'volume_create_manager' (7816f564-aadd-4c2d-8462-766d104f3ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:13:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3e1c3d51-909c-43c3-9dd8-ebf9666d4735 tempest-GroupsTest-1962535541 None] Created volume successfully.
Sep 23 15:13:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-1a6afdb2-e3dc-4db6-8f30-769d44557e6f req-d00e28f0-a6db-4eb0-91e8-b84f6ad1bbdd tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-1a6afdb2-e3dc-4db6-8f30-769d44557e6f req-d00e28f0-a6db-4eb0-91e8-b84f6ad1bbdd tempest-AttachVolumeNegativeTest-1403103512 None] Terminate volume connection completed successfully.
Sep 23 15:13:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-1a6afdb2-e3dc-4db6-8f30-769d44557e6f req-d00e28f0-a6db-4eb0-91e8-b84f6ad1bbdd tempest-AttachVolumeNegativeTest-1403103512 None] Deleting attachment 54943a8d-768e-4403-b397-93b290eb0546. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:13:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Acquiring lock "cinder-quobyte-c02fb900-1c99-47ff-a2c9-db543152a328" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:13:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Lock "cinder-quobyte-c02fb900-1c99-47ff-a2c9-db543152a328" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:13:50 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6147093-8ab8-42c5-9450-556b2c0feaa9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:13:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:51 devstack quobyte-client[84024]: System call of process 91736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:13:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328" returned: 0 in 0.991s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c02fb900-1c99-47ff-a2c9-db543152a328" returned: 0 in 0.204s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Lock "cinder-quobyte-c02fb900-1c99-47ff-a2c9-db543152a328" released by "delete_volume" :: held 1.498s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:13:52 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Created reservations ['e2fd4391-c217-4643-9282-74357e68c098'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:13:52 devstack cinder-volume[84009]: WARNING cinder.quota [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1728829624 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1728829624, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:13:52 devstack cinder-volume[84009]: WARNING cinder.quota [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1728829624 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1728829624, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:13:52 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Created reservations ['84ba1c84-acd6-4059-9cac-fe9834af28e2', 'af633bf0-8433-4a0e-9ac3-d01301e3848e', 'aae7c3cb-a607-4226-a8e3-5575fd87fc0e', '5e401d9e-e847-4369-a26e-833f3360ae71'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.237s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:53 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:13:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-bca074f6-22e3-4b3d-b38a-d5f85776d8a3 tempest-GroupsTest-1962535541 None] Delete group completed successfully.
Sep 23 15:13:54 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Created reservations ['e51fd624-bb85-41b5-9a10-fac4e4f39a29'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:13:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:13:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.320s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:13:55 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:13:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3d7e930d-3a5e-43d3-a309-de22ce100fcd tempest-GroupsTest-1962535541 None] Delete group completed successfully.
Sep 23 15:13:58 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2b65f10a-1015-4fe2-871e-d13a48aeb854 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:13:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2b65f10a-1015-4fe2-871e-d13a48aeb854 tempest-GroupsTest-1962535541 None] Group tempest-GroupsTest-Group-1870681964: creating
Sep 23 15:13:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2b65f10a-1015-4fe2-871e-d13a48aeb854 tempest-GroupsTest-1962535541 None] Group tempest-GroupsTest-Group-1870681964: created successfully
Sep 23 15:13:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2b65f10a-1015-4fe2-871e-d13a48aeb854 tempest-GroupsTest-1962535541 None] Create group completed successfully.
Sep 23 15:14:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:14:01 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:14:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Flow 'volume_create_manager' (bd3eec42-7f43-46d5-80b7-b52698fb309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c111de2-71ca-4974-a48a-8a4a1ad5dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c111de2-71ca-4974-a48a-8a4a1ad5dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155711194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15f5ddde-b584-42c2-b571-bf96c6d6a83f,host='devstack@QuobyteHD#QuobyteHD',id=6fa1d51a-9c3b-4058-837f-b7060924eac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232589a76a54e92afac6dfe5bb5a189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:14:01Z,use_quota=True,user_id='ca48dbee25f34faeaf8dc0f8a9f4d07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46f272c1-4b6d-4d35-a821-89a0c42d220d),volume_type_id=46f272c1-4b6d-4d35-a821-89a0c42d220d)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ddc17-56c2-45d4-819b-7857dfd05ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760ddc17-56c2-45d4-819b-7857dfd05ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e2eec0-5724-4908-8fa6-88aa25847243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e2eec0-5724-4908-8fa6-88aa25847243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa1d51a-9c3b-4058-837f-b7060924eac7', 'volume_name': 'volume-6fa1d51a-9c3b-4058-837f-b7060924eac7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82638428-0d72-41fc-aa00-6b52742a64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82638428-0d72-41fc-aa00-6b52742a64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da7c906-3d8b-4f14-a661-209a5883d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:02 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Volume 6fa1d51a-9c3b-4058-837f-b7060924eac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa1d51a-9c3b-4058-837f-b7060924eac7', 'volume_size': 1}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15f5ddde-b584-42c2-b571-bf96c6d6a83f,created_at=2025-09-23T13:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-155711194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15f5ddde-b584-42c2-b571-bf96c6d6a83f,host='devstack@QuobyteHD#QuobyteHD',id=6fa1d51a-9c3b-4058-837f-b7060924eac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232589a76a54e92afac6dfe5bb5a189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:14:01Z,use_quota=True,user_id='ca48dbee25f34faeaf8dc0f8a9f4d07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46f272c1-4b6d-4d35-a821-89a0c42d220d),volume_type_id=46f272c1-4b6d-4d35-a821-89a0c42d220d)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Creating volume 6fa1d51a-9c3b-4058-837f-b7060924eac7 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:14:02 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:14:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:02 devstack quobyte-client[84024]: System call of process 91804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:02 devstack quobyte-client[84024]: System call of process 91804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:02 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=20, name=volume-6fa1d51a-9c3b-4058-837f-b7060924eac7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:14:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7 1073741824" returned: 0 in 1.546s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7" returned: 0 in 0.297s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] <== create_volume: return (1968ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:14:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da7c906-3d8b-4f14-a661-209a5883d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa1d51a-9c3b-4058-837f-b7060924eac7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd90090-0957-4eca-85a0-d73ad412bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:05 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Volume volume-6fa1d51a-9c3b-4058-837f-b7060924eac7 (6fa1d51a-9c3b-4058-837f-b7060924eac7): created successfully
Sep 23 15:14:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd90090-0957-4eca-85a0-d73ad412bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Flow 'volume_create_manager' (bd3eec42-7f43-46d5-80b7-b52698fb309c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:14:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2f5126a4-41a5-467a-a125-5c17db42c72f tempest-GroupsTest-1962535541 None] Created volume successfully.
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 1.451s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:14:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Flow 'volume_create_manager' (78754ee3-167d-4284-a35e-ded86ca61983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce828db-49eb-4996-8b3c-7323d5cf9dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce828db-49eb-4996-8b3c-7323d5cf9dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892501563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15f5ddde-b584-42c2-b571-bf96c6d6a83f,host='devstack@QuobyteHD#QuobyteHD',id=c24cfc36-158d-461e-b018-351533786ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232589a76a54e92afac6dfe5bb5a189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:14:09Z,use_quota=True,user_id='ca48dbee25f34faeaf8dc0f8a9f4d07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46f272c1-4b6d-4d35-a821-89a0c42d220d),volume_type_id=46f272c1-4b6d-4d35-a821-89a0c42d220d)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc989a0-63f8-4cff-baf2-b43dea10b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc989a0-63f8-4cff-baf2-b43dea10b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80325fd9-eb7a-4c12-8fa4-8ebbb1d78f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80325fd9-eb7a-4c12-8fa4-8ebbb1d78f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24cfc36-158d-461e-b018-351533786ca9', 'volume_name': 'volume-c24cfc36-158d-461e-b018-351533786ca9', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b9184d-2b70-408c-a30c-0b072d442c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b9184d-2b70-408c-a30c-0b072d442c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec291999-97a8-46ed-be17-a637b2045cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Volume c24cfc36-158d-461e-b018-351533786ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24cfc36-158d-461e-b018-351533786ca9', 'volume_size': 1}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15f5ddde-b584-42c2-b571-bf96c6d6a83f,created_at=2025-09-23T13:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892501563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15f5ddde-b584-42c2-b571-bf96c6d6a83f,host='devstack@QuobyteHD#QuobyteHD',id=c24cfc36-158d-461e-b018-351533786ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232589a76a54e92afac6dfe5bb5a189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:14:09Z,use_quota=True,user_id='ca48dbee25f34faeaf8dc0f8a9f4d07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46f272c1-4b6d-4d35-a821-89a0c42d220d),volume_type_id=46f272c1-4b6d-4d35-a821-89a0c42d220d)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Creating volume c24cfc36-158d-461e-b018-351533786ca9 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:14:10 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:14:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:11 devstack quobyte-client[84024]: System call of process 91869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:11 devstack quobyte-client[84024]: System call of process 91869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:11 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=21, name=volume-c24cfc36-158d-461e-b018-351533786ca9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:14:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9 1073741824" returned: 0 in 0.874s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9" returned: 0 in 0.606s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] <== create_volume: return (1631ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:14:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec291999-97a8-46ed-be17-a637b2045cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24cfc36-158d-461e-b018-351533786ca9', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d915d0d-a2a5-45e2-ad65-eafec6c2fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Volume volume-c24cfc36-158d-461e-b018-351533786ca9 (c24cfc36-158d-461e-b018-351533786ca9): created successfully
Sep 23 15:14:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d915d0d-a2a5-45e2-ad65-eafec6c2fa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Flow 'volume_create_manager' (78754ee3-167d-4284-a35e-ded86ca61983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:14:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-cbf06b34-2e36-4428-aac2-aa67c8c58642 tempest-GroupsTest-1962535541 None] Created volume successfully.
Sep 23 15:14:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d872dba6-c6f5-42d3-accc-ff57a1e13829 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:14:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d872dba6-c6f5-42d3-accc-ff57a1e13829 tempest-GroupsTest-1962535541 None] Update group completed successfully.
Sep 23 15:14:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9611e219-3419-43e9-b7d0-a3ab6508ddd3 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:14:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9611e219-3419-43e9-b7d0-a3ab6508ddd3 tempest-GroupsTest-1962535541 None] Update group completed successfully.
Sep 23 15:14:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:14:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Acquiring lock "cinder-quobyte-6fa1d51a-9c3b-4058-837f-b7060924eac7" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:14:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Lock "cinder-quobyte-6fa1d51a-9c3b-4058-837f-b7060924eac7" acquired by "delete_volume" :: waited 0.051s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:14:18 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce99c8-c6e7-4f5d-909a-712127cb1e12]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:14:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:18 devstack quobyte-client[84024]: System call of process 91900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7" returned: 0 in 0.685s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6fa1d51a-9c3b-4058-837f-b7060924eac7" returned: 0 in 0.119s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Lock "cinder-quobyte-6fa1d51a-9c3b-4058-837f-b7060924eac7" released by "delete_volume" :: held 1.079s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Acquiring lock "cinder-quobyte-c24cfc36-158d-461e-b018-351533786ca9" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Lock "cinder-quobyte-c24cfc36-158d-461e-b018-351533786ca9" acquired by "delete_volume" :: waited 0.082s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d1c5f-0b97-44ba-a199-7a23a3b9226a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:14:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:20 devstack quobyte-client[84024]: System call of process 91904 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:20 devstack quobyte-client[84024]: System call of process 91904 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9" returned: 0 in 0.547s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c24cfc36-158d-461e-b018-351533786ca9" returned: 0 in 0.113s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Lock "cinder-quobyte-c24cfc36-158d-461e-b018-351533786ca9" released by "delete_volume" :: held 0.907s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:14:20 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Created reservations ['5c4d6aba-a99a-4e5b-8d4b-c3970787c560'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:14:20 devstack cinder-volume[84009]: WARNING cinder.quota [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1369969084 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1369969084, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:14:20 devstack cinder-volume[84009]: WARNING cinder.quota [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1369969084 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1369969084, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:14:20 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Created reservations ['5e98cdd3-a66b-46b5-ae1e-84bbbad9193b', '545034e4-61ae-4d67-bd85-5f582ef8f7fa', 'fce117f4-3e5a-4cc7-8ab1-4a0cc60a3d0e', '538e13ce-8065-4bef-b2a3-6619b19ad0a9'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Created reservations ['9fba0a9f-f083-4a70-a9ef-a03b3ed1c94a', '4ec61a7d-7123-4c1e-8738-3c2646ac0af2', '8a0f74b0-38d7-4583-8f30-bc018acde99e', 'b90dd4cb-4939-41d9-9922-592bfd65eeb6'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.121s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:21 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:14:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-655454d4-8eb4-4819-900b-7ee8f14cdde6 tempest-GroupsTest-1962535541 None] Delete group completed successfully.
Sep 23 15:14:31 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=43,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:14:31 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:14:58 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Flow 'volume_create_manager' (3c0588ea-ed57-4583-a3be-7a7851a19e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881cbd71-eeaf-44df-8c28-06d20f75a981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881cbd71-eeaf-44df-8c28-06d20f75a981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1817023176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ea8d76-5daf-4192-8015-4316613ad1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8aff5614864373a2696dcd929e6512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:14:58Z,use_quota=True,user_id='3acb8724776645d2b4725047948fef0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f73e60e-d8e7-47e9-ae8d-9d43d4907ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f73e60e-d8e7-47e9-ae8d-9d43d4907ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0f1391-7d8d-48ed-8382-e90b92155e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0f1391-7d8d-48ed-8382-e90b92155e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ea8d76-5daf-4192-8015-4316613ad1af', 'volume_name': 'volume-22ea8d76-5daf-4192-8015-4316613ad1af', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d676198e-98dc-4f6b-b455-ae3a004e6170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d676198e-98dc-4f6b-b455-ae3a004e6170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdf092b-1648-4f19-bf33-d20c32063a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:14:58 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume 22ea8d76-5daf-4192-8015-4316613ad1af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ea8d76-5daf-4192-8015-4316613ad1af', 'volume_size': 1}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1817023176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ea8d76-5daf-4192-8015-4316613ad1af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8aff5614864373a2696dcd929e6512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:14:58Z,use_quota=True,user_id='3acb8724776645d2b4725047948fef0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Creating volume 22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:14:58 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:14:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:59 devstack quobyte-client[84024]: System call of process 92040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:14:59 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=22, name=volume-22ea8d76-5daf-4192-8015-4316613ad1af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af 1073741824" returned: 0 in 0.522s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af" returned: 0 in 0.179s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] <== create_volume: return (878ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdf092b-1648-4f19-bf33-d20c32063a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ea8d76-5daf-4192-8015-4316613ad1af', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:14:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ed439e-6c2c-430c-910e-d00a06a05859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:15:00 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume volume-22ea8d76-5daf-4192-8015-4316613ad1af (22ea8d76-5daf-4192-8015-4316613ad1af): created successfully
Sep 23 15:15:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ed439e-6c2c-430c-910e-d00a06a05859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:15:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Flow 'volume_create_manager' (3c0588ea-ed57-4583-a3be-7a7851a19e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:15:00 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8184249f-5f18-4c29-916a-b6550f61eef8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Created volume successfully.
Sep 23 15:15:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Creating offline snapshot 5dfa8728-d5d2-484d-a4e0-a5f5f54653ce of volume 22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c3b423-e183-48c8-b625-ff1d7f91c847]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:01 devstack quobyte-client[84024]: System call of process 92044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:01 devstack quobyte-client[84024]: System call of process 92044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:01 devstack quobyte-client[84024]: System call of process 92044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af" returned: 0 in 0.590s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:02 devstack quobyte-client[84024]: System call of process 92047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:02 devstack quobyte-client[84024]: System call of process 92047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:02 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=23, name=volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce 1G" returned: 0 in 0.379s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): qemu-img rebase -u -b volume-22ea8d76-5daf-4192-8015-4316613ad1af -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "qemu-img rebase -u -b volume-22ea8d76-5daf-4192-8015-4316613ad1af -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" returned: 0 in 0.215s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" returned: 0 in 0.131s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" returned: 0 in 0.141s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.info" returned: 0 in 0.163s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:15:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.info" returned: 0 in 0.116s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:15:03 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b20c8d2e-5b78-4294-8f9a-b0c4b25c58ea tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Create snapshot completed successfully
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "cinder-5dfa8728-d5d2-484d-a4e0-a5f5f54653ce-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-5dfa8728-d5d2-484d-a4e0-a5f5f54653ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.098s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:15:05 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "cinder-quobyte-22ea8d76-5daf-4192-8015-4316613ad1af" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-quobyte-22ea8d76-5daf-4192-8015-4316613ad1af" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "cinder-quobyte-5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-quobyte-5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Deleting offline snapshot 5dfa8728-d5d2-484d-a4e0-a5f5f54653ce of volume 22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] snapshot_file for this snap is: volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb9e72-d349-4375-8651-47a457809dec]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:15:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:06 devstack quobyte-client[84024]: System call of process 92060 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" returned: 0 in 0.712s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ea8d76-5daf-4192-8015-4316613ad1af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:15:06 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd512ad3-9bf4-41a5-ab0f-2a82de2e9b90]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:15:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:07 devstack quobyte-client[84024]: System call of process 92063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:15:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af" returned: 0 in 1.013s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" returned: 0 in 1.027s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:15:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af.5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" returned: 0 in 0.399s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-quobyte-5dfa8728-d5d2-484d-a4e0-a5f5f54653ce" released by "_delete_snapshot" :: held 3.882s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:15:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.305s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:15:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-quobyte-22ea8d76-5daf-4192-8015-4316613ad1af" released by "delete_snapshot" :: held 4.008s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:15:09 devstack cinder-volume[84009]: WARNING cinder.quota [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:15:09 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Created reservations ['e4f13f66-ce40-4b61-b5c1-7ca7b32fa2d1', '5614eb01-df42-44f4-869a-8e4760e605a1', '56be983d-b448-4d56-be24-60e738ac9c66', 'eca51ca9-a395-49e0-96ad-bf68814bf5bc'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:15:09 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Delete snapshot completed successfully.
Sep 23 15:15:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0194f2f9-5c60-41cc-b21f-546a8bfc268c tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-5dfa8728-d5d2-484d-a4e0-a5f5f54653ce-delete_snapshot" released by "delete_snapshot" :: held 4.737s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:15:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "cinder-22ea8d76-5daf-4192-8015-4316613ad1af-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:15:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-22ea8d76-5daf-4192-8015-4316613ad1af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:15:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:15:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "cinder-quobyte-22ea8d76-5daf-4192-8015-4316613ad1af" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:15:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-quobyte-22ea8d76-5daf-4192-8015-4316613ad1af" acquired by "delete_volume" :: waited 0.013s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:15:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c339acb-f6cd-45bc-be0f-5f3e77db3164]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:15:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af" returned: 0 in 0.562s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ea8d76-5daf-4192-8015-4316613ad1af" returned: 0 in 0.111s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-quobyte-22ea8d76-5daf-4192-8015-4316613ad1af" released by "delete_volume" :: held 0.946s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Created reservations ['fb17e0c2-9afe-4904-9c28-4b398cb83d9b', '3a4c149f-ebb3-44ca-9c48-5107315c8f17', '9a7f0a65-fbab-4ed2-a894-3c54f2ebca48', '42f4c0c1-8b09-4551-9106-0db35200fa8e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.101s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:15:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Deleted volume successfully.
Sep 23 15:15:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-20f8c89d-2437-4a28-8218-2637ad169a35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1978474454 None] Lock "cinder-22ea8d76-5daf-4192-8015-4316613ad1af-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:15:22 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:15:22 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:15:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-fae027d9-5cab-467b-95a3-6b03418d24d1 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:15:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-fae027d9-5cab-467b-95a3-6b03418d24d1 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:15:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-fae027d9-5cab-467b-95a3-6b03418d24d1 tempest-TaggedBootDevicesTest-528340984 None] Terminate volume connection completed successfully.
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-fae027d9-5cab-467b-95a3-6b03418d24d1 tempest-TaggedBootDevicesTest-528340984 None] Deleting attachment 7b99ae31-e747-4554-a3e6-376a86bedfd1. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:15:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Flow 'volume_create_manager' (fa7be294-b2ca-4f89-93d8-22bcf5254c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7434ee-904c-472b-bab3-66333a18ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7434ee-904c-472b-bab3-66333a18ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1290872654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5efd94-8fb6-45ca-a9b7-29ca9fefd954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8a1f61b064e41a9ed7263e4848527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:15:59Z,use_quota=True,user_id='37f3d124e7384eb08a5aac3dbbb24aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23240c0-7657-4833-960d-b6e65917e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:15:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23240c0-7657-4833-960d-b6e65917e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca718ec-d4fc-41e4-87b1-860717d1d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca718ec-d4fc-41e4-87b1-860717d1d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5efd94-8fb6-45ca-a9b7-29ca9fefd954', 'volume_name': 'volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef777e46-7198-471a-81bf-348760d09903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef777e46-7198-471a-81bf-348760d09903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6663aaa-e106-46b2-90cc-308cd053a902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:00 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Volume 6d5efd94-8fb6-45ca-a9b7-29ca9fefd954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954', 'volume_size': 1}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1290872654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5efd94-8fb6-45ca-a9b7-29ca9fefd954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8a1f61b064e41a9ed7263e4848527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:15:59Z,use_quota=True,user_id='37f3d124e7384eb08a5aac3dbbb24aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Creating volume 6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:16:00 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:16:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:00 devstack quobyte-client[84024]: System call of process 92526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:00 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=25, name=volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:16:00 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-197da71b-8756-476f-a413-849a50e04878 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 1073741824" returned: 0 in 0.987s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-197da71b-8756-476f-a413-849a50e04878 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-197da71b-8756-476f-a413-849a50e04878 tempest-TaggedBootDevicesTest-528340984 None] Terminate volume connection completed successfully.
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-197da71b-8756-476f-a413-849a50e04878 tempest-TaggedBootDevicesTest-528340984 None] Deleting attachment a69bb95f-86b4-457b-953b-451d21e5ccb4. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" returned: 0 in 0.372s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] <== create_volume: return (1417ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6663aaa-e106-46b2-90cc-308cd053a902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f30176-fdb6-4145-8778-0f629881b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:01 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Volume volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 (6d5efd94-8fb6-45ca-a9b7-29ca9fefd954): created successfully
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f30176-fdb6-4145-8778-0f629881b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Flow 'volume_create_manager' (fa7be294-b2ca-4f89-93d8-22bcf5254c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:16:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-16b88c94-a2c4-4c18-8208-64a9aaaeefef tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-582452b5-e616-49f4-9a3a-b29cf9c01762 tempest-AttachVolumeNegativeTest-1403103512 None] Created volume successfully.
Sep 23 15:16:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-16b88c94-a2c4-4c18-8208-64a9aaaeefef tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-16b88c94-a2c4-4c18-8208-64a9aaaeefef tempest-TaggedBootDevicesTest-528340984 None] Terminate volume connection completed successfully.
Sep 23 15:16:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-a98ab24a-d728-45b5-82cd-1848e692c820 req-16b88c94-a2c4-4c18-8208-64a9aaaeefef tempest-TaggedBootDevicesTest-528340984 None] Deleting attachment 5a69bb67-0e5c-4018-9772-308d4f956296. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:16:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:07 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd80edd-49d6-4fcf-9bf8-b5d82b775b48]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:16:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:07 devstack quobyte-client[84024]: System call of process 92539 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" returned: 0 in 0.688s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f662fb4-493f-428a-a83c-c0554a3d535d', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:16:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:08 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-c0baa6bc-ff3e-4d22-afcf-a5d25b0f27b9 req-c201dd08-5cdb-4afb-8a28-66029a2f7fab tempest-AttachVolumeNegativeTest-1403103512 None] attachment_update completed successfully.
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.286s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:16:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "cinder-b0fb63d0-252f-409c-8a31-0b4b4d1d5354-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-b0fb63d0-252f-409c-8a31-0b4b4d1d5354-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "cinder-quobyte-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-quobyte-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ce8c1-b83b-4cec-bd2b-50f38a91326f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:16:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" returned: 0 in 0.508s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" returned: 0 in 0.161s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-quobyte-b0fb63d0-252f-409c-8a31-0b4b4d1d5354" released by "delete_volume" :: held 0.845s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:14 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Created reservations ['41af9aca-763b-467d-a2c4-5445cea83baa', 'ff9ae9fa-209f-4fbb-81df-b7161f274443', '55a484ea-4b44-46b2-b818-923794b59a9c', 'f0927303-3bbe-4f79-b635-18059a5a8b2f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.092s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:16:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Deleted volume successfully.
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "cinder-bba29c62-2144-46a3-9231-84c13517b6d6-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2878af4-8860-4458-81d5-ebf2eb0e6270 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-b0fb63d0-252f-409c-8a31-0b4b4d1d5354-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-bba29c62-2144-46a3-9231-84c13517b6d6-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "cinder-quobyte-bba29c62-2144-46a3-9231-84c13517b6d6" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-quobyte-bba29c62-2144-46a3-9231-84c13517b6d6" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0562c-56b1-4e6c-b5e8-1b6193bb597f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6" returned: 0 in 0.484s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bba29c62-2144-46a3-9231-84c13517b6d6" returned: 0 in 0.092s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-quobyte-bba29c62-2144-46a3-9231-84c13517b6d6" released by "delete_volume" :: held 0.753s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Created reservations ['216bc462-61d1-459a-8e74-96f853d51c9e', 'e128116f-e80f-4066-a70b-bd2b12e17ed3', '7ecb1ba7-c182-4ddc-b907-f21b2f6cd7c5', '2d72727b-a8e0-4a8f-996a-2aecde6216fb'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.087s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:16:17 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Deleted volume successfully.
Sep 23 15:16:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-55c4446d-14c6-4ac7-b838-7b5262bb05fa tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-bba29c62-2144-46a3-9231-84c13517b6d6-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "cinder-bda91cb6-a916-43bd-af93-ca742604c675-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-bda91cb6-a916-43bd-af93-ca742604c675-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "cinder-quobyte-bda91cb6-a916-43bd-af93-ca742604c675" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-quobyte-bda91cb6-a916-43bd-af93-ca742604c675" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:18 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e286f244-c7b0-48a7-8347-fcb20cf50f2e]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:16:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 0 in 0.591s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:19 devstack quobyte-client[84024]: System call of process 92980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 1 in 0.510s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:16:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-bda91cb6-a916-43bd-af93-ca742604c675" returned: 0 in 0.093s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-quobyte-bda91cb6-a916-43bd-af93-ca742604c675" released by "delete_volume" :: held 1.676s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Created reservations ['81b9b08e-cc33-4106-bc46-6ff417d15b48', 'c3d5aa51-c558-495c-9c52-fb76d40ae522', '499d7f5b-6f0b-4b7f-9f4d-5426a6839c4c', 'caf39040-4dbe-4939-a97c-ddef264751f1'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.138s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:20 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:16:20 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Deleted volume successfully.
Sep 23 15:16:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f555ec95-67c8-4ea0-acd4-a8e0c5eaf372 tempest-TaggedBootDevicesTest-528340984 None] Lock "cinder-bda91cb6-a916-43bd-af93-ca742604c675-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:30 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=9 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:16:31 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=3,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:16:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-27104714-c7c7-4bb7-8083-d43006921411 req-fda41b4b-3b91-4614-956d-d7b9f32b781b tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-27104714-c7c7-4bb7-8083-d43006921411 req-fda41b4b-3b91-4614-956d-d7b9f32b781b tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:39 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-27104714-c7c7-4bb7-8083-d43006921411 req-fda41b4b-3b91-4614-956d-d7b9f32b781b tempest-AttachVolumeNegativeTest-1403103512 None] Terminate volume connection completed successfully.
Sep 23 15:16:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-27104714-c7c7-4bb7-8083-d43006921411 req-fda41b4b-3b91-4614-956d-d7b9f32b781b tempest-AttachVolumeNegativeTest-1403103512 None] Deleting attachment 5f662fb4-493f-428a-a83c-c0554a3d535d. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:16:44 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (f39c9572-3b48-47f9-a2f6-f367984959c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecf66fd-d3b0-4e51-9c32-0690b2333eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecf66fd-d3b0-4e51-9c32-0690b2333eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1426965763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f87930-2c32-4439-998a-8d0a6e2b2045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:16:44Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f08f4e-3ed9-4e47-8947-0fa02aa1f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f08f4e-3ed9-4e47-8947-0fa02aa1f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d98d2d5-f8ee-4533-a171-40ca0c0b9fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d98d2d5-f8ee-4533-a171-40ca0c0b9fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f87930-2c32-4439-998a-8d0a6e2b2045', 'volume_name': 'volume-37f87930-2c32-4439-998a-8d0a6e2b2045', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c953263-92cc-4675-8fab-d43b2302af7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c953263-92cc-4675-8fab-d43b2302af7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b66566-63cd-4155-90de-49a138dec760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:44 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Volume 37f87930-2c32-4439-998a-8d0a6e2b2045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f87930-2c32-4439-998a-8d0a6e2b2045', 'volume_size': 1}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1426965763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f87930-2c32-4439-998a-8d0a6e2b2045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:16:44Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Creating volume 37f87930-2c32-4439-998a-8d0a6e2b2045 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:16:44 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:16:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:45 devstack quobyte-client[84024]: System call of process 93170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:45 devstack quobyte-client[84024]: System call of process 93170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:45 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=26, name=volume-37f87930-2c32-4439-998a-8d0a6e2b2045, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:16:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045 1073741824" returned: 0 in 0.676s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045" returned: 0 in 0.291s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] <== create_volume: return (1057ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:16:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b66566-63cd-4155-90de-49a138dec760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f87930-2c32-4439-998a-8d0a6e2b2045', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352a5c94-0616-4221-b09e-aa1c0959ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:16:46 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Volume volume-37f87930-2c32-4439-998a-8d0a6e2b2045 (37f87930-2c32-4439-998a-8d0a6e2b2045): created successfully
Sep 23 15:16:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352a5c94-0616-4221-b09e-aa1c0959ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:16:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (f39c9572-3b48-47f9-a2f6-f367984959c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:16:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a03d0709-8b48-449c-a1ca-e9fe3011d573 tempest-VolumesActionsTest-1404868709 None] Created volume successfully.
Sep 23 15:16:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c3e34ead-da5a-4f72-816b-e7314a53fd0a tempest-VolumesActionsTest-1404868709 None] Acquiring lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045" by "attach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c3e34ead-da5a-4f72-816b-e7314a53fd0a tempest-VolumesActionsTest-1404868709 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045" acquired by "attach_volume" :: waited 0.109s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c3e34ead-da5a-4f72-816b-e7314a53fd0a tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c3e34ead-da5a-4f72-816b-e7314a53fd0a tempest-VolumesActionsTest-1404868709 None] Attaching volume 37f87930-2c32-4439-998a-8d0a6e2b2045 to instance 03afdeae-f53c-4484-ac2d-8949e7ed09df at mountpoint /dev/vdb on host None.
Sep 23 15:16:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c3e34ead-da5a-4f72-816b-e7314a53fd0a tempest-VolumesActionsTest-1404868709 None] Attach volume completed successfully.
Sep 23 15:16:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c3e34ead-da5a-4f72-816b-e7314a53fd0a tempest-VolumesActionsTest-1404868709 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045" released by "attach_volume" :: held 0.585s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:49 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Terminate volume connection completed successfully.
Sep 23 15:16:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-detach_volume" by "detach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Detaching volume 37f87930-2c32-4439-998a-8d0a6e2b2045 from instance 03afdeae-f53c-4484-ac2d-8949e7ed09df.
Sep 23 15:16:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Detach volume completed successfully.
Sep 23 15:16:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-97ebe136-5b18-439b-8390-5cec77e9d792 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-detach_volume" released by "detach_volume" :: held 0.160s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a2b50ac5-571e-4d72-8ff5-04fd8e086258 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-detach_volume" by "detach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a2b50ac5-571e-4d72-8ff5-04fd8e086258 tempest-VolumesActionsTest-1404868709 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:51 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a2b50ac5-571e-4d72-8ff5-04fd8e086258 tempest-VolumesActionsTest-1404868709 None] Volume detach called, but volume not attached.
Sep 23 15:16:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a2b50ac5-571e-4d72-8ff5-04fd8e086258 tempest-VolumesActionsTest-1404868709 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:16:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "cinder-quobyte-37f87930-2c32-4439-998a-8d0a6e2b2045" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:16:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Lock "cinder-quobyte-37f87930-2c32-4439-998a-8d0a6e2b2045" acquired by "delete_volume" :: waited 0.034s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:16:52 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7933ecc-7be7-4c68-a038-ec8c5e80e80f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:16:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:53 devstack quobyte-client[84024]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:53 devstack quobyte-client[84024]: System call of process 93180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:16:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045" returned: 0 in 1.088s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-37f87930-2c32-4439-998a-8d0a6e2b2045" returned: 0 in 0.390s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Lock "cinder-quobyte-37f87930-2c32-4439-998a-8d0a6e2b2045" released by "delete_volume" :: held 1.917s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Created reservations ['6d394076-5278-412d-a30c-22e64a482d7f', 'fc0d2144-e783-446a-b19e-6c2f2b416bc0', '8d081d46-417a-4e0f-bc08-e5b1eec657cd', '19929f8a-4055-4f92-87a3-fc4136fb0eee'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.300s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:16:55 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:16:56 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Deleted volume successfully.
Sep 23 15:16:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40adb46b-3cf3-46b4-a762-6da898670d86 tempest-VolumesActionsTest-1404868709 None] Lock "cinder-37f87930-2c32-4439-998a-8d0a6e2b2045-delete_volume" released by "delete_volume" :: held 5.000s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:17:05 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (2ff6cc81-b8d8-46cc-b731-71bb9f60d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77509896-53e1-4103-a0b3-91871ae782c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77509896-53e1-4103-a0b3-91871ae782c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152828175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f2b34a-c277-485f-8615-cd08613c2617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:05Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686e450d-0240-43e5-baf8-d9a3c5f9f7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686e450d-0240-43e5-baf8-d9a3c5f9f7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da00524-4065-4d1d-8b5d-2b8f66a5a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da00524-4065-4d1d-8b5d-2b8f66a5a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f2b34a-c277-485f-8615-cd08613c2617', 'volume_name': 'volume-a7f2b34a-c277-485f-8615-cd08613c2617', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd1b697-266d-4a1e-abef-43ef7502a450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd1b697-266d-4a1e-abef-43ef7502a450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972844-88e5-41e6-ac6e-00596f895e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:05 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Volume a7f2b34a-c277-485f-8615-cd08613c2617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f2b34a-c277-485f-8615-cd08613c2617', 'volume_size': 1}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152828175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f2b34a-c277-485f-8615-cd08613c2617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:05Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Creating volume a7f2b34a-c277-485f-8615-cd08613c2617 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:17:05 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:17:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:06 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=27, name=volume-a7f2b34a-c277-485f-8615-cd08613c2617, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:17:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617 1073741824" returned: 0 in 0.483s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617" returned: 0 in 0.244s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] <== create_volume: return (843ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:17:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972844-88e5-41e6-ac6e-00596f895e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f2b34a-c277-485f-8615-cd08613c2617', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc138184-7192-45db-b09f-ed8e23d60824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:07 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Volume volume-a7f2b34a-c277-485f-8615-cd08613c2617 (a7f2b34a-c277-485f-8615-cd08613c2617): created successfully
Sep 23 15:17:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc138184-7192-45db-b09f-ed8e23d60824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (2ff6cc81-b8d8-46cc-b731-71bb9f60d410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:07 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b14d41e1-2ecf-4775-b866-071a22ab84f0 tempest-VolumesActionsTest-1404868709 None] Created volume successfully.
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-a7f2b34a-c277-485f-8615-cd08613c2617-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Lock "cinder-a7f2b34a-c277-485f-8615-cd08613c2617-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-quobyte-a7f2b34a-c277-485f-8615-cd08613c2617" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-a7f2b34a-c277-485f-8615-cd08613c2617" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5dac4c-72a4-4afe-854e-c6f183100339]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.249s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:17:09 devstack quobyte-client[84024]: System call of process 93235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617" returned: 0 in 0.865s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a7f2b34a-c277-485f-8615-cd08613c2617" returned: 0 in 0.320s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-a7f2b34a-c277-485f-8615-cd08613c2617" released by "delete_volume" :: held 1.407s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:10 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Created reservations ['9213627e-cecc-4289-80f4-6fa5d2843643', '9949a771-5531-4513-b0e1-e89f69e4ce67', '7036dbc0-4e1e-44a0-88c4-187322fb9ae5', '673da5b4-69dc-4505-88a8-d8bae90bf538'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:17:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.330s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:12 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:17:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Deleted volume successfully.
Sep 23 15:17:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b823e9d-7946-4a70-b2a7-2782302058ef tempest-VolumesActionsTest-1540567149 None] Lock "cinder-a7f2b34a-c277-485f-8615-cd08613c2617-delete_volume" released by "delete_volume" :: held 4.244s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:12 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (a1c9b053-b22c-4b2e-b26e-8ca68d5bea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0b0c29-bb83-42eb-bd7c-41301b248967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0b0c29-bb83-42eb-bd7c-41301b248967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-610465634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac103942-ec14-46fa-9827-f6414e1b811b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:13Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6987678-765b-4fb7-a8d6-08fbb6dfb3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6987678-765b-4fb7-a8d6-08fbb6dfb3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c41b007-2954-4059-af1e-a33be86fff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c41b007-2954-4059-af1e-a33be86fff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac103942-ec14-46fa-9827-f6414e1b811b', 'volume_name': 'volume-ac103942-ec14-46fa-9827-f6414e1b811b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e403f4-c0e1-461e-92a5-1bf49f8b4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e403f4-c0e1-461e-92a5-1bf49f8b4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ffb12-821f-4c78-907d-9509f0dbd108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Volume ac103942-ec14-46fa-9827-f6414e1b811b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac103942-ec14-46fa-9827-f6414e1b811b', 'volume_size': 1}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-610465634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac103942-ec14-46fa-9827-f6414e1b811b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:13Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Creating volume ac103942-ec14-46fa-9827-f6414e1b811b {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:17:13 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:13 devstack quobyte-client[84024]: System call of process 93285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=28, name=volume-ac103942-ec14-46fa-9827-f6414e1b811b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b 1073741824" returned: 0 in 0.553s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b" returned: 0 in 0.232s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ffb12-821f-4c78-907d-9509f0dbd108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac103942-ec14-46fa-9827-f6414e1b811b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8fef0d-1bb7-4c3e-9bd9-c26841814da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Volume volume-ac103942-ec14-46fa-9827-f6414e1b811b (ac103942-ec14-46fa-9827-f6414e1b811b): created successfully
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8fef0d-1bb7-4c3e-9bd9-c26841814da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (a1c9b053-b22c-4b2e-b26e-8ca68d5bea16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-90811ef9-0161-4cc7-a8f3-5d924e6ea9fe tempest-VolumesActionsTest-1404868709 None] Created volume successfully.
Sep 23 15:17:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-ac103942-ec14-46fa-9827-f6414e1b811b-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-ac103942-ec14-46fa-9827-f6414e1b811b-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-quobyte-ac103942-ec14-46fa-9827-f6414e1b811b" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-ac103942-ec14-46fa-9827-f6414e1b811b" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d30a9-d609-458b-8c08-d1710297c86a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:17:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b" returned: 0 in 0.530s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ac103942-ec14-46fa-9827-f6414e1b811b" returned: 0 in 0.095s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-ac103942-ec14-46fa-9827-f6414e1b811b" released by "delete_volume" :: held 0.796s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Created reservations ['260f9123-1f47-401a-91fd-eb86e9524c17', 'ecd14707-cf36-45c8-aebf-712c91ead052', '03581db0-50d6-4123-84fb-28819b812d37', '84272504-0f9e-443b-82fe-a56c44f737ef'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.085s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:17 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:17:17 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Deleted volume successfully.
Sep 23 15:17:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9ad53fe3-fdf9-4461-a842-2c47ab92c982 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-ac103942-ec14-46fa-9827-f6414e1b811b-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (6698a36a-fd3d-4f44-bf7e-95b6107abff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb74d453-f1ce-4b9a-b590-4dd44e707fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb74d453-f1ce-4b9a-b590-4dd44e707fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17619505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efcc368-41c4-438f-abae-7aece6f02bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:18Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336d1e5a-bc11-4977-bf79-6590dee9256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336d1e5a-bc11-4977-bf79-6590dee9256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8affd034-84ba-4828-968e-473187971c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8affd034-84ba-4828-968e-473187971c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efcc368-41c4-438f-abae-7aece6f02bcf', 'volume_name': 'volume-4efcc368-41c4-438f-abae-7aece6f02bcf', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f350f723-7576-42db-bdff-32cf8b12b246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f350f723-7576-42db-bdff-32cf8b12b246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96071734-883b-477d-a325-7afdefffa4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Volume 4efcc368-41c4-438f-abae-7aece6f02bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efcc368-41c4-438f-abae-7aece6f02bcf', 'volume_size': 1}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17619505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efcc368-41c4-438f-abae-7aece6f02bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:18Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Creating volume 4efcc368-41c4-438f-abae-7aece6f02bcf {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:17:18 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:17:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:18 devstack quobyte-client[84024]: System call of process 93304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:18 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=29, name=volume-4efcc368-41c4-438f-abae-7aece6f02bcf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf 1073741824" returned: 0 in 0.610s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf" returned: 0 in 0.315s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] <== create_volume: return (1062ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96071734-883b-477d-a325-7afdefffa4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efcc368-41c4-438f-abae-7aece6f02bcf', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10025fc-da16-43bf-a17d-2be3567eb04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:20 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Volume volume-4efcc368-41c4-438f-abae-7aece6f02bcf (4efcc368-41c4-438f-abae-7aece6f02bcf): created successfully
Sep 23 15:17:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10025fc-da16-43bf-a17d-2be3567eb04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (6698a36a-fd3d-4f44-bf7e-95b6107abff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:20 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d2e6eb79-c3da-4bb9-a8b5-3c803ff10241 tempest-VolumesActionsTest-1404868709 None] Created volume successfully.
Sep 23 15:17:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-4efcc368-41c4-438f-abae-7aece6f02bcf-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Lock "cinder-4efcc368-41c4-438f-abae-7aece6f02bcf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:21 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-quobyte-4efcc368-41c4-438f-abae-7aece6f02bcf" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-4efcc368-41c4-438f-abae-7aece6f02bcf" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6873f84f-0c07-4e25-81a8-f83a90deefc4]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:17:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf" returned: 0 in 1.996s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4efcc368-41c4-438f-abae-7aece6f02bcf" returned: 0 in 0.474s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-4efcc368-41c4-438f-abae-7aece6f02bcf" released by "delete_volume" :: held 3.188s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Created reservations ['9719a9c9-6204-4fdf-9c2c-4b73d21d3fb8', 'd7765dfe-469a-42a8-b118-48197a76f200', 'd285917a-5006-4127-961b-0325cbf1c5eb', '2e291e04-62f3-4131-a7cb-daaf9e05b977'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.104s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.330s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:26 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:17:26 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Deleted volume successfully.
Sep 23 15:17:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d6fde06d-8880-4a24-bcc4-8ee288f0b88c tempest-VolumesActionsTest-1540567149 None] Lock "cinder-4efcc368-41c4-438f-abae-7aece6f02bcf-delete_volume" released by "delete_volume" :: held 6.699s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:28 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (a3cf36ce-ccef-4643-9c8f-b891e856b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2903200f-0ba8-4a1b-98ee-a7a3fee02d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2903200f-0ba8-4a1b-98ee-a7a3fee02d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1482908121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4546b-4e1c-417e-9990-338ca0b3e425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:28Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c446a08-e73e-4983-a7cd-63188f335522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c446a08-e73e-4983-a7cd-63188f335522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e07b95-10b6-4261-94e2-029f109721ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e07b95-10b6-4261-94e2-029f109721ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af4546b-4e1c-417e-9990-338ca0b3e425', 'volume_name': 'volume-8af4546b-4e1c-417e-9990-338ca0b3e425', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bba861f-941c-46ea-8675-20844ae45c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bba861f-941c-46ea-8675-20844ae45c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77840d4a-89db-4a37-9602-62f2e4c7177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:29 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Volume 8af4546b-4e1c-417e-9990-338ca0b3e425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af4546b-4e1c-417e-9990-338ca0b3e425', 'volume_size': 1}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1482908121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4546b-4e1c-417e-9990-338ca0b3e425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:28Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Creating volume 8af4546b-4e1c-417e-9990-338ca0b3e425 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:17:29 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:29 devstack quobyte-client[84024]: System call of process 93404 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:29 devstack quobyte-client[84024]: System call of process 93404 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:29 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=30, name=volume-8af4546b-4e1c-417e-9990-338ca0b3e425, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425 1073741824" returned: 0 in 0.606s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425" returned: 0 in 0.315s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] <== create_volume: return (1201ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:17:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77840d4a-89db-4a37-9602-62f2e4c7177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af4546b-4e1c-417e-9990-338ca0b3e425', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd80f32-afa1-4a72-ad21-27ff3291a804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:31 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Volume volume-8af4546b-4e1c-417e-9990-338ca0b3e425 (8af4546b-4e1c-417e-9990-338ca0b3e425): created successfully
Sep 23 15:17:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd80f32-afa1-4a72-ad21-27ff3291a804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (a3cf36ce-ccef-4643-9c8f-b891e856b0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:31 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-df8d59b4-3785-4d47-b619-c6d868998be5 tempest-VolumesActionsTest-1404868709 None] Created volume successfully.
Sep 23 15:17:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-8af4546b-4e1c-417e-9990-338ca0b3e425-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-8af4546b-4e1c-417e-9990-338ca0b3e425-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:32 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "cinder-quobyte-8af4546b-4e1c-417e-9990-338ca0b3e425" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-8af4546b-4e1c-417e-9990-338ca0b3e425" acquired by "delete_volume" :: waited 0.029s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[770dd690-22c4-4388-a603-0add014a7c0e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:17:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:33 devstack quobyte-client[84024]: System call of process 93424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425" returned: 0 in 0.965s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8af4546b-4e1c-417e-9990-338ca0b3e425" returned: 0 in 0.258s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-quobyte-8af4546b-4e1c-417e-9990-338ca0b3e425" released by "delete_volume" :: held 1.590s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Created reservations ['d4d8ba87-70c4-4487-9617-cd7db57db947', '8a1c6b63-be0d-44d1-a14d-b69413461c9f', '557dce96-e93f-4b03-ab2f-a65372d37caf', '3d150885-9c18-4a5c-812c-9ad01549336a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.115s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:34 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:17:34 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Deleted volume successfully.
Sep 23 15:17:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c4d2f362-5c00-4846-8b49-465ee57ec2e4 tempest-VolumesActionsTest-1540567149 None] Lock "cinder-8af4546b-4e1c-417e-9990-338ca0b3e425-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (36aa27a1-8d4d-4e19-aa4e-cf57ff9ad410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1f3c10-d840-4d5c-b3e5-458f90105c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1f3c10-d840-4d5c-b3e5-458f90105c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322012052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3e7de8-5665-41be-8dcb-c1db52dffaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:37Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a1529d-e13d-4def-a709-cb56a7af242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a1529d-e13d-4def-a709-cb56a7af242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5ee03f-0cdf-4c5a-9717-8adc5a953337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5ee03f-0cdf-4c5a-9717-8adc5a953337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3e7de8-5665-41be-8dcb-c1db52dffaf3', 'volume_name': 'volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d8e3ed-d55a-460e-a5e5-17d456006c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d8e3ed-d55a-460e-a5e5-17d456006c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f542f30-b1bb-47ad-939b-f392b3461b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:37 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Volume 1c3e7de8-5665-41be-8dcb-c1db52dffaf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3', 'volume_size': 1}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322012052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3e7de8-5665-41be-8dcb-c1db52dffaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830a4b1e823b48e183f450ace67d1c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:17:37Z,use_quota=True,user_id='a204f72a71214c7fac4379b7f7f88e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Creating volume 1c3e7de8-5665-41be-8dcb-c1db52dffaf3 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:17:37 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:17:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:38 devstack quobyte-client[84024]: System call of process 93446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:38 devstack quobyte-client[84024]: System call of process 93446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:17:38 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=31, name=volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:17:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3 1073741824" returned: 0 in 1.720s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3" returned: 0 in 0.398s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] <== create_volume: return (2608ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:17:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.624s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f542f30-b1bb-47ad-939b-f392b3461b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41faf3cf-265f-4c3f-865e-1a0b3304b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:17:41 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=34,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:17:41 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Volume volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3 (1c3e7de8-5665-41be-8dcb-c1db52dffaf3): created successfully
Sep 23 15:17:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41faf3cf-265f-4c3f-865e-1a0b3304b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:17:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Flow 'volume_create_manager' (36aa27a1-8d4d-4e19-aa4e-cf57ff9ad410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:17:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-de68102a-4cbe-4b1d-90c8-0b28afa5c239 tempest-VolumesActionsTest-1404868709 None] Created volume successfully.
Sep 23 15:17:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Acquiring lock "cinder-1c3e7de8-5665-41be-8dcb-c1db52dffaf3-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Lock "cinder-1c3e7de8-5665-41be-8dcb-c1db52dffaf3-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:17:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Acquiring lock "cinder-quobyte-1c3e7de8-5665-41be-8dcb-c1db52dffaf3" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:17:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Lock "cinder-quobyte-1c3e7de8-5665-41be-8dcb-c1db52dffaf3" acquired by "delete_volume" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:17:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1b7d9-d414-42d7-9bf5-fd7a99450467]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:17:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3" returned: 0 in 2.104s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1c3e7de8-5665-41be-8dcb-c1db52dffaf3" returned: 0 in 0.361s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Lock "cinder-quobyte-1c3e7de8-5665-41be-8dcb-c1db52dffaf3" released by "delete_volume" :: held 3.443s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:17:50 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Created reservations ['22c84e7e-9318-4a9a-83cb-23add023ce73', '7780a111-1bac-4cea-9494-bbd6dd3cb956', '1e010047-07ee-4bef-a617-8a90c265a0c0', '07c930bd-bb9c-4997-8b03-246d814c0bf2'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.354s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:17:51 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:17:52 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Deleted volume successfully.
Sep 23 15:17:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa9da21f-9920-45ce-b634-23c94668666c tempest-VolumesActionsTest-1404868709 None] Lock "cinder-1c3e7de8-5665-41be-8dcb-c1db52dffaf3-delete_volume" released by "delete_volume" :: held 7.332s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:01 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:INSERT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:18:02 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=54,cinder:SELECT=33,cinder:INSERT=14,cinder:DELETE=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.507s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:18:13 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:18:14 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:18:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:34 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:18:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Flow 'volume_create_manager' (aef574c8-6b9d-4037-8570-7570f739abeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e968580-2a07-4dba-9916-dbd2ee4df3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e968580-2a07-4dba-9916-dbd2ee4df3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1842691421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b5a6da-0c8c-4781-84a8-e26de7dbb346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff7376718cd44919e4a16ffee68689a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:34Z,use_quota=True,user_id='4f1159f610114c6d8ec10aae6bde9a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa2230d-6a86-4aec-a8b7-8d299c965f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa2230d-6a86-4aec-a8b7-8d299c965f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c7e36-4b98-4d03-b206-b039d8977ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6c7e36-4b98-4d03-b206-b039d8977ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b5a6da-0c8c-4781-84a8-e26de7dbb346', 'volume_name': 'volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566edd8d-570d-4f98-bab7-25c6f92e29f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566edd8d-570d-4f98-bab7-25c6f92e29f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df54982-57b1-431b-8b9b-75679968d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:35 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Volume c0b5a6da-0c8c-4781-84a8-e26de7dbb346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346', 'volume_size': 1}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1842691421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b5a6da-0c8c-4781-84a8-e26de7dbb346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff7376718cd44919e4a16ffee68689a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:34Z,use_quota=True,user_id='4f1159f610114c6d8ec10aae6bde9a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Creating volume c0b5a6da-0c8c-4781-84a8-e26de7dbb346 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:18:35 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:18:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:36 devstack quobyte-client[84024]: System call of process 93759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:36 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=32, name=volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:18:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346 1073741824" returned: 0 in 1.819s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346" returned: 0 in 0.308s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] <== create_volume: return (2434ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:18:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:38 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df54982-57b1-431b-8b9b-75679968d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:38 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede1277c-859a-438f-937c-517329b195f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:38 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Volume volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346 (c0b5a6da-0c8c-4781-84a8-e26de7dbb346): created successfully
Sep 23 15:18:38 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede1277c-859a-438f-937c-517329b195f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Flow 'volume_create_manager' (aef574c8-6b9d-4037-8570-7570f739abeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:39 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8c4148fb-ebee-4bf3-ba9f-977191a73047 tempest-VolumesListAdminTestJSON-1194729103 None] Created volume successfully.
Sep 23 15:18:40 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Flow 'volume_create_manager' (0beee860-f34b-4ae1-8e10-bdaaa6eba788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89206f3-4c5b-4dd1-8378-f4c1dcebf250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89206f3-4c5b-4dd1-8378-f4c1dcebf250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-650565079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ccb1b-7086-428a-a4ff-ae49f3d30e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff7376718cd44919e4a16ffee68689a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:41Z,use_quota=True,user_id='4f1159f610114c6d8ec10aae6bde9a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e9abdf-8ceb-4b89-906e-a0a3fab0ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e9abdf-8ceb-4b89-906e-a0a3fab0ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994c4959-8fe3-405c-891f-5a1ca55a229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994c4959-8fe3-405c-891f-5a1ca55a229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34ccb1b-7086-428a-a4ff-ae49f3d30e2f', 'volume_name': 'volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe3188f-e466-403c-944f-b015696bf325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe3188f-e466-403c-944f-b015696bf325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1849ee62-bd8d-41df-b99b-7ee013da6dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:40 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Volume b34ccb1b-7086-428a-a4ff-ae49f3d30e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f', 'volume_size': 1}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-650565079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34ccb1b-7086-428a-a4ff-ae49f3d30e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff7376718cd44919e4a16ffee68689a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:41Z,use_quota=True,user_id='4f1159f610114c6d8ec10aae6bde9a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Creating volume b34ccb1b-7086-428a-a4ff-ae49f3d30e2f {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:18:41 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:41 devstack quobyte-client[84024]: System call of process 93784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:41 devstack quobyte-client[84024]: System call of process 93784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:41 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=33, name=volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f 1073741824" returned: 0 in 0.464s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f" returned: 0 in 0.254s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] <== create_volume: return (843ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:18:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1849ee62-bd8d-41df-b99b-7ee013da6dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079ca1c3-2921-467a-bb3e-ea3ec59764b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:42 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Volume volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f (b34ccb1b-7086-428a-a4ff-ae49f3d30e2f): created successfully
Sep 23 15:18:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079ca1c3-2921-467a-bb3e-ea3ec59764b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Flow 'volume_create_manager' (0beee860-f34b-4ae1-8e10-bdaaa6eba788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7d1f675b-3431-4072-8c6b-6691d5f04ca9 tempest-VolumesListAdminTestJSON-1194729103 None] Created volume successfully.
Sep 23 15:18:43 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Flow 'volume_create_manager' (c132625d-9018-4d25-bca4-abe14ff509fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99440a13-802b-4151-bfa3-feef11de42fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99440a13-802b-4151-bfa3-feef11de42fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-882595277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69960fc2-7f4d-4446-8dca-98729bb7c38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff7376718cd44919e4a16ffee68689a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:43Z,use_quota=True,user_id='4f1159f610114c6d8ec10aae6bde9a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb4892d-87fa-4465-b04c-16881e57bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb4892d-87fa-4465-b04c-16881e57bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c6469b-ecf0-4451-932f-f21f3e8f82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c6469b-ecf0-4451-932f-f21f3e8f82a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69960fc2-7f4d-4446-8dca-98729bb7c38d', 'volume_name': 'volume-69960fc2-7f4d-4446-8dca-98729bb7c38d', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a95d53a-e08e-47f5-a9bf-9933ee87e61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a95d53a-e08e-47f5-a9bf-9933ee87e61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afc3154-66eb-49d6-8ded-2e397d60a2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:43 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Volume 69960fc2-7f4d-4446-8dca-98729bb7c38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69960fc2-7f4d-4446-8dca-98729bb7c38d', 'volume_size': 1}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-882595277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69960fc2-7f4d-4446-8dca-98729bb7c38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff7376718cd44919e4a16ffee68689a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:43Z,use_quota=True,user_id='4f1159f610114c6d8ec10aae6bde9a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Creating volume 69960fc2-7f4d-4446-8dca-98729bb7c38d {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:18:43 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:18:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:43 devstack quobyte-client[84024]: System call of process 93789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:43 devstack quobyte-client[84024]: System call of process 93789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:43 devstack quobyte-client[84024]: System call of process 93789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:43 devstack quobyte-client[84024]: System call of process 93789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:44 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=34, name=volume-69960fc2-7f4d-4446-8dca-98729bb7c38d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d 1073741824" returned: 0 in 0.495s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d" returned: 0 in 0.116s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] <== create_volume: return (687ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afc3154-66eb-49d6-8ded-2e397d60a2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69960fc2-7f4d-4446-8dca-98729bb7c38d', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d74b62-6bd9-4a53-b5ae-58ecefb1993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:44 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Volume volume-69960fc2-7f4d-4446-8dca-98729bb7c38d (69960fc2-7f4d-4446-8dca-98729bb7c38d): created successfully
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d74b62-6bd9-4a53-b5ae-58ecefb1993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Flow 'volume_create_manager' (c132625d-9018-4d25-bca4-abe14ff509fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8351f14a-c6af-4103-948f-ee20640fdc5e tempest-VolumesListAdminTestJSON-1194729103 None] Created volume successfully.
Sep 23 15:18:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:46 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Flow 'volume_create_manager' (a0c78f8a-a9f3-4427-8179-abde275f58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436c41f1-f9b5-443c-a29e-ffc9f9584f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436c41f1-f9b5-443c-a29e-ffc9f9584f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d6adfc-3bc3-4782-a71b-c26beba58f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6577f309255b4422a2443944c71a2d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:47Z,use_quota=True,user_id='d5c4fb73d3fb46eeb0ec5d1ae66b0b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d70554-e164-4245-acd2-8b4795eed8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d70554-e164-4245-acd2-8b4795eed8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6939995a-b2a4-4802-bf07-b49800e514c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6939995a-b2a4-4802-bf07-b49800e514c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d6adfc-3bc3-4782-a71b-c26beba58f61', 'volume_name': 'volume-73d6adfc-3bc3-4782-a71b-c26beba58f61', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea6697-d5d4-4e51-bb86-1c421e7cd4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea6697-d5d4-4e51-bb86-1c421e7cd4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf0b926-bdad-4552-9258-a55f70584de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:47 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Volume 73d6adfc-3bc3-4782-a71b-c26beba58f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d6adfc-3bc3-4782-a71b-c26beba58f61', 'volume_size': 1}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d6adfc-3bc3-4782-a71b-c26beba58f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6577f309255b4422a2443944c71a2d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:47Z,use_quota=True,user_id='d5c4fb73d3fb46eeb0ec5d1ae66b0b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Creating volume 73d6adfc-3bc3-4782-a71b-c26beba58f61 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:18:47 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:18:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:47 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=35, name=volume-73d6adfc-3bc3-4782-a71b-c26beba58f61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61 1073741824" returned: 0 in 0.848s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61" returned: 0 in 0.227s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] <== create_volume: return (1177ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf0b926-bdad-4552-9258-a55f70584de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d6adfc-3bc3-4782-a71b-c26beba58f61', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7681200-b1d3-4209-b72d-332a0d373a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Flow 'volume_create_manager' (53d3a53e-266d-41e7-85c1-72d7e09c0136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd2cac3-fba4-4cab-b228-1ebe9eac1add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Volume volume-73d6adfc-3bc3-4782-a71b-c26beba58f61 (73d6adfc-3bc3-4782-a71b-c26beba58f61): created successfully
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7681200-b1d3-4209-b72d-332a0d373a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Flow 'volume_create_manager' (a0c78f8a-a9f3-4427-8179-abde275f58ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd2cac3-fba4-4cab-b228-1ebe9eac1add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1149953333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5473df9ab21b482da41cad82fa5b9f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:48Z,use_quota=True,user_id='541a21b9bd974042b40b6e9a8d070e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0d8561-1acc-412e-af7a-bcbd46cce9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0d8561-1acc-412e-af7a-bcbd46cce9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ac59cd-9938-4993-9491-1e46102cc727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ac59cd-9938-4993-9491-1e46102cc727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4', 'volume_name': 'volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379cff57-04b7-4809-81e0-56b4acfbd079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379cff57-04b7-4809-81e0-56b4acfbd079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e8d9ac-3c0a-4c37-af01-aa17b4edd6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:49 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Volume 3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4', 'volume_size': 1}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1149953333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5473df9ab21b482da41cad82fa5b9f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:48Z,use_quota=True,user_id='541a21b9bd974042b40b6e9a8d070e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Creating volume 3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:18:49 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:49 devstack quobyte-client[84024]: System call of process 93800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-adc8a959-04ff-4f69-8392-bd96063a941e tempest-VolumesListAdminTestJSON-13381238 None] Created volume successfully.
Sep 23 15:18:49 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=36, name=volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 1073741824" returned: 0 in 0.595s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4" returned: 0 in 0.133s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:18:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e8d9ac-3c0a-4c37-af01-aa17b4edd6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a76c48-77c4-41e8-96a5-168db0cbba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Acquiring lock "cinder-73d6adfc-3bc3-4782-a71b-c26beba58f61-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Volume volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 (3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4): created successfully
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a76c48-77c4-41e8-96a5-168db0cbba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Flow 'volume_create_manager' (53d3a53e-266d-41e7-85c1-72d7e09c0136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Lock "cinder-73d6adfc-3bc3-4782-a71b-c26beba58f61-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "cinder-69960fc2-7f4d-4446-8dca-98729bb7c38d-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Acquiring lock "cinder-quobyte-73d6adfc-3bc3-4782-a71b-c26beba58f61" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e9a548e-873f-479b-982e-d656817d3945 tempest-ServersNegativeTestJSON-1258356554 None] Created volume successfully.
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-69960fc2-7f4d-4446-8dca-98729bb7c38d-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Lock "cinder-quobyte-73d6adfc-3bc3-4782-a71b-c26beba58f61" acquired by "delete_volume" :: waited 0.079s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab04ffb3-dfdc-4cb5-bedf-0b7fb8721061]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:18:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:51 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "cinder-quobyte-69960fc2-7f4d-4446-8dca-98729bb7c38d" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-quobyte-69960fc2-7f4d-4446-8dca-98729bb7c38d" acquired by "delete_volume" :: waited 0.107s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:51 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5e4b79-2d15-4862-8d0c-cfdfa82c8a08]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:18:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61" returned: 0 in 1.301s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:52 devstack quobyte-client[84024]: System call of process 93806 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73d6adfc-3bc3-4782-a71b-c26beba58f61" returned: 0 in 0.308s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Lock "cinder-quobyte-73d6adfc-3bc3-4782-a71b-c26beba58f61" released by "delete_volume" :: held 2.050s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d" returned: 0 in 1.567s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69960fc2-7f4d-4446-8dca-98729bb7c38d" returned: 0 in 0.383s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-quobyte-69960fc2-7f4d-4446-8dca-98729bb7c38d" released by "delete_volume" :: held 2.270s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Created reservations ['e91eee4a-9e00-47c9-8176-904389a899da', '99af348d-f90b-4660-99b8-96c3d93f7f7d', 'bf69cf69-d848-4353-9143-d15ee9954730', '52fe4330-e337-4357-ae6b-87396f44829a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Created reservations ['c67ca6ac-2d20-4bdd-b9b2-dac1ec440c54', 'c2c29d88-00f7-49e3-a082-17152428b543', '1e6da980-a3a1-484c-9a9b-9c0e01705e15', '2bd6bc50-bb7a-47dc-93a2-b95ba7b1abf4'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.070s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.593s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:54 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:18:54 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Deleted volume successfully.
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "cinder-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.965s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:18:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Deleted volume successfully.
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fba7a5ee-77e8-48ca-ba23-0fd6ebf5780f tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-69960fc2-7f4d-4446-8dca-98729bb7c38d-delete_volume" released by "delete_volume" :: held 4.543s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f-delete_volume" acquired by "delete_volume" :: waited 0.169s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2ecc28e8-5123-40cc-9981-df852c5546c3 tempest-VolumesListAdminTestJSON-13381238 None] Lock "cinder-73d6adfc-3bc3-4782-a71b-c26beba58f61-delete_volume" released by "delete_volume" :: held 4.814s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Flow 'volume_create_manager' (d2d890cd-c49b-4adc-9015-173641dfaa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed87d89a-2565-415b-80d1-970b65e666a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed87d89a-2565-415b-80d1-970b65e666a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-585882418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68480567-ef23-4df7-a4d6-2cc3df852340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5473df9ab21b482da41cad82fa5b9f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:55Z,use_quota=True,user_id='541a21b9bd974042b40b6e9a8d070e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ee6d3c-fe95-4044-8465-b36a06ddae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ee6d3c-fe95-4044-8465-b36a06ddae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a9b8a7-d0e2-4b09-a7fa-bb43d8662ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a9b8a7-d0e2-4b09-a7fa-bb43d8662ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68480567-ef23-4df7-a4d6-2cc3df852340', 'volume_name': 'volume-68480567-ef23-4df7-a4d6-2cc3df852340', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4408ec2-9a3d-4c54-bc8d-ee247b4bc2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4408ec2-9a3d-4c54-bc8d-ee247b4bc2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e578a2-c4f6-4864-8830-42687cc47f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:55 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Volume 68480567-ef23-4df7-a4d6-2cc3df852340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68480567-ef23-4df7-a4d6-2cc3df852340', 'volume_size': 1}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-585882418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68480567-ef23-4df7-a4d6-2cc3df852340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5473df9ab21b482da41cad82fa5b9f11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:18:55Z,use_quota=True,user_id='541a21b9bd974042b40b6e9a8d070e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Creating volume 68480567-ef23-4df7-a4d6-2cc3df852340 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:18:55 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:18:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:55 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=37, name=volume-68480567-ef23-4df7-a4d6-2cc3df852340, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340 1073741824" returned: 0 in 0.746s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "cinder-quobyte-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340" returned: 0 in 0.344s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-quobyte-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f" acquired by "delete_volume" :: waited 0.142s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] <== create_volume: return (1190ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1129b768-f115-48f0-a1ae-262dda4c32c1]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:18:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e578a2-c4f6-4864-8830-42687cc47f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68480567-ef23-4df7-a4d6-2cc3df852340', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a44560-d3b9-4fdc-b643-1fb70b2db76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:18:57 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Volume volume-68480567-ef23-4df7-a4d6-2cc3df852340 (68480567-ef23-4df7-a4d6-2cc3df852340): created successfully
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a44560-d3b9-4fdc-b643-1fb70b2db76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Flow 'volume_create_manager' (d2d890cd-c49b-4adc-9015-173641dfaa03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f" returned: 0 in 0.703s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f" returned: 0 in 0.172s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1fbf400d-56ee-4b16-b7c6-112214131a0b tempest-ServersNegativeTestJSON-1258356554 None] Created volume successfully.
Sep 23 15:18:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-quobyte-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f" released by "delete_volume" :: held 1.245s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Created reservations ['5cffb04a-d576-4fbe-88bb-c9ef26f21268', '79d8eb93-96eb-4a16-908b-6e3a13f2d0d0', '17f73856-e48c-4a9d-946c-894951243fa7', '977b56bf-46c0-4584-bafa-22cf361a4924'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.104s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:18:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Deleted volume successfully.
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "cinder-c0b5a6da-0c8c-4781-84a8-e26de7dbb346-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1cb86d71-d200-4c1e-84f5-1af695872450 tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-b34ccb1b-7086-428a-a4ff-ae49f3d30e2f-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:18:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-c0b5a6da-0c8c-4781-84a8-e26de7dbb346-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:18:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "cinder-quobyte-c0b5a6da-0c8c-4781-84a8-e26de7dbb346" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-quobyte-c0b5a6da-0c8c-4781-84a8-e26de7dbb346" acquired by "delete_volume" :: waited 0.025s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:59 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7609de5-0332-4446-83cd-f9560a5c65f3]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:18:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:18:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "cinder-68480567-ef23-4df7-a4d6-2cc3df852340-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:18:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-68480567-ef23-4df7-a4d6-2cc3df852340-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:18:59 devstack quobyte-client[84024]: System call of process 93841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:59 devstack quobyte-client[84024]: System call of process 93841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:18:59 devstack quobyte-client[84024]: System call of process 93841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:00 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "cinder-quobyte-68480567-ef23-4df7-a4d6-2cc3df852340" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346" returned: 0 in 0.828s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-quobyte-68480567-ef23-4df7-a4d6-2cc3df852340" acquired by "delete_volume" :: waited 0.243s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c0b5a6da-0c8c-4781-84a8-e26de7dbb346" returned: 0 in 0.288s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88c5abb-b033-4218-8e22-e1215c2b3e28]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-quobyte-c0b5a6da-0c8c-4781-84a8-e26de7dbb346" released by "delete_volume" :: held 1.379s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Created reservations ['b768f61e-afc9-43ff-9968-b33e93633f89', '361758ef-362e-4410-a46a-be16a35e0ae7', 'f017dbb8-fe5d-45e7-af53-da36d9fcdf02', 'c83180ba-ed94-4465-9643-9cdcc18dc5a1'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:01 devstack quobyte-client[84024]: System call of process 93845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:01 devstack quobyte-client[84024]: System call of process 93845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340" returned: 0 in 1.010s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68480567-ef23-4df7-a4d6-2cc3df852340" returned: 0 in 0.444s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-quobyte-68480567-ef23-4df7-a4d6-2cc3df852340" released by "delete_volume" :: held 1.717s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.429s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:19:02 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Deleted volume successfully.
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f02d202-dcec-44f1-ac16-115fd37046cc tempest-VolumesListAdminTestJSON-1194729103 None] Lock "cinder-c0b5a6da-0c8c-4781-84a8-e26de7dbb346-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Created reservations ['1ea54251-9eaf-4cdb-a8c5-db6cfca81f23', '96d33736-9107-4f05-8038-cf8545405fd8', '74768be7-1d69-4838-9e68-f6af7318c1de', '67eda98e-f5a5-4c97-9809-ffdb222ca550'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.208s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:02 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:19:02 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Deleted volume successfully.
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "cinder-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c6b68332-b3dd-41c4-9f8d-8d7942c604ed tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-68480567-ef23-4df7-a4d6-2cc3df852340-delete_volume" released by "delete_volume" :: held 3.655s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:03 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "cinder-quobyte-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-quobyte-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4" acquired by "delete_volume" :: waited 0.022s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f8c92-d697-48e4-af5c-fb7e5f158452]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:04 devstack quobyte-client[84024]: System call of process 93851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4" returned: 0 in 0.715s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4" returned: 0 in 0.116s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-quobyte-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4" released by "delete_volume" :: held 1.139s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:04 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Created reservations ['5c9e75c6-252c-49ad-b6e9-468da23718f7', '78369dfd-d78e-4fac-ab30-4afa339168b4', 'b06b7e5c-b606-4641-878b-1ebaa3433505', '135786d6-9c9e-4e63-955d-6bb58621dd5d'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.139s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:19:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Deleted volume successfully.
Sep 23 15:19:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-40d69dcc-b9d6-4bc8-8f37-c1fc4ffbc0e1 tempest-ServersNegativeTestJSON-1258356554 None] Lock "cinder-3a3fb927-2bfd-471f-bc3c-4ff0cc5644d4-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.194s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:19:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Flow 'volume_create_manager' (6e85dcf6-60d7-46c8-8b1f-52597056bbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c279e1f8-ac2b-43ea-a919-a9bcfc6036cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c279e1f8-ac2b-43ea-a919-a9bcfc6036cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1771946869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eb16dd-a917-43dc-92a0-b095b3301456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b15f59148f4283a7fe9e58a6bae6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:11Z,use_quota=True,user_id='136b4643f91e4a29b8c7f79ba3dd4be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4525fb-5bb7-42f2-9758-94f9b716bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4525fb-5bb7-42f2-9758-94f9b716bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235cda9a-824f-4c45-96b4-97a00923170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:19:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Flow 'volume_create_manager' (d6a4878c-7357-4268-8171-da6b63086b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c38fe01-34bd-436a-955b-54187a8254e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c38fe01-34bd-436a-955b-54187a8254e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-3646826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a2b59f-db33-441e-9fd2-86d802f3b9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8a1f61b064e41a9ed7263e4848527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:11Z,use_quota=True,user_id='37f3d124e7384eb08a5aac3dbbb24aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6ff34b-020b-45fc-b560-59deb4e57bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6ff34b-020b-45fc-b560-59deb4e57bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ffe25c-41a2-4988-9788-2a49215ce91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ffe25c-41a2-4988-9788-2a49215ce91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a2b59f-db33-441e-9fd2-86d802f3b9cb', 'volume_name': 'volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33a9427-b87e-48f0-aa57-a096bccfefb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33a9427-b87e-48f0-aa57-a096bccfefb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6176aaac-cefa-48ca-b02d-38d916f29de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Volume 68a2b59f-db33-441e-9fd2-86d802f3b9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb', 'volume_size': 1}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-3646826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a2b59f-db33-441e-9fd2-86d802f3b9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c8a1f61b064e41a9ed7263e4848527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:11Z,use_quota=True,user_id='37f3d124e7384eb08a5aac3dbbb24aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Creating volume 68a2b59f-db33-441e-9fd2-86d802f3b9cb {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:19:12 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:12 devstack quobyte-client[84024]: System call of process 93912 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:12 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=38, name=volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb 1073741824" returned: 0 in 0.563s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb" returned: 0 in 0.382s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] <== create_volume: return (1045ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6176aaac-cefa-48ca-b02d-38d916f29de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6de07ca-374c-47fd-b439-d8788b52297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235cda9a-824f-4c45-96b4-97a00923170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93eb16dd-a917-43dc-92a0-b095b3301456', 'volume_name': 'volume-93eb16dd-a917-43dc-92a0-b095b3301456', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728aede70>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925cc41e-9468-4fc1-9f50-484ded884c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925cc41e-9468-4fc1-9f50-484ded884c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5fe8e7-b8cc-45a3-ac2f-489e0483dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Volume 93eb16dd-a917-43dc-92a0-b095b3301456: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93eb16dd-a917-43dc-92a0-b095b3301456', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728aede70>}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Cloning 93eb16dd-a917-43dc-92a0-b095b3301456 from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:19:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Volume volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb (68a2b59f-db33-441e-9fd2-86d802f3b9cb): created successfully
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6de07ca-374c-47fd-b439-d8788b52297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Flow 'volume_create_manager' (d6a4878c-7357-4268-8171-da6b63086b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2d934d86-5232-4be3-9707-433e2ddd1001 tempest-AttachVolumeNegativeTest-1403103512 None] Created volume successfully.
Sep 23 15:19:14 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:19:14 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 15:19:14 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd9164-fb5a-4dac-9c94-a558ddcbc9f7]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:14 devstack sudo[93916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD
Sep 23 15:19:14 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:19:17 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root
Sep 23 15:19:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD" returned: 0 in 3.359s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:17 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 is fetched for user 136b4643f91e4a29b8c7f79ba3dd4be1. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:19:18 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2e982a-62dd-4258-bb21-6144d5f01283]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:18 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD
Sep 23 15:19:18 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:19:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.063s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed4ba7d-b27a-4ae4-88a9-9f27b852abe9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:20 devstack quobyte-client[84024]: System call of process 93965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb" returned: 0 in 0.986s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.113s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0a9ca62-c71a-4f1a-a65d-739e1a8a9a90', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:19:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:20 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-9cbff1ed-7876-43a9-bc33-736fb62d1edc req-f248b375-3f0d-4ddf-864e-3655b6e2228e tempest-AttachVolumeNegativeTest-1403103512 None] attachment_update completed successfully.
Sep 23 15:19:21 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Sep 23 15:19:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD" returned: 0 in 3.829s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1771946869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eb16dd-a917-43dc-92a0-b095b3301456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b15f59148f4283a7fe9e58a6bae6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:11Z,use_quota=True,user_id='136b4643f91e4a29b8c7f79ba3dd4be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Creating volume 93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:19:22 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:22 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=39, name=volume-93eb16dd-a917-43dc-92a0-b095b3301456, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 1073741824" returned: 0 in 0.758s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 0 in 0.141s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] <== create_volume: return (1010ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:19:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:23 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Attempting download of 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume 93eb16dd-a917-43dc-92a0-b095b3301456. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:19:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[563c0533-20fd-43e3-8471-63fcb35dbcc6]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_79dx6kvv {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_79dx6kvv" returned: 0 in 0.619s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_79dx6kvv {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_79dx6kvv" returned: 1 in 0.608s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_79dx6kvv' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:19:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8bf6fe-d68b-4b85-95d4-5334d60cf3e1]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:25 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] 26f34a6e-cf6d-4d01-b96a-d62e819357f3 was qcow2, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:19:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:25 devstack quobyte-client[84024]: System call of process 94370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:25 devstack quobyte-client[84024]: System call of process 94370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:25 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=39, name=volume-93eb16dd-a917-43dc-92a0-b095b3301456, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 0 in 1.561s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:27 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_xemkrly5devstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:19:27 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Converted 112.00 MB image at 69.15 MB/s
Sep 23 15:19:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 1G" returned: 0 in 0.294s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:27 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e870c-0daa-4454-9669-4587ff9d5b7d]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:28 devstack quobyte-client[84024]: System call of process 94388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:28 devstack quobyte-client[84024]: System call of process 94388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:28 devstack quobyte-client[84024]: System call of process 94388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:28 devstack quobyte-client[84024]: System call of process 94388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 0 in 0.779s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:29 devstack quobyte-client[84024]: System call of process 94391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 1 in 0.834s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:19:29 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Downloaded image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume 93eb16dd-a917-43dc-92a0-b095b3301456 successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:19:29 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 for user 136b4643f91e4a29b8c7f79ba3dd4be1 is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:19:29 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Marking volume 93eb16dd-a917-43dc-92a0-b095b3301456 as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:19:29 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=77,cinder:SELECT=49,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Copying metadata from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 to 93eb16dd-a917-43dc-92a0-b095b3301456. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Creating volume glance metadata for volume 93eb16dd-a917-43dc-92a0-b095b3301456 backed by image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=41,cinder:UPDATE=54,cinder:DELETE=9,cinder:INSERT=15 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5fe8e7-b8cc-45a3-ac2f-489e0483dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93eb16dd-a917-43dc-92a0-b095b3301456', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728aede70>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd7577a-7b4f-4e1c-b06a-b1d3313e399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:30 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Volume volume-93eb16dd-a917-43dc-92a0-b095b3301456 (93eb16dd-a917-43dc-92a0-b095b3301456): created successfully
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd7577a-7b4f-4e1c-b06a-b1d3313e399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Flow 'volume_create_manager' (6e85dcf6-60d7-46c8-8b1f-52597056bbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-74af767f-7fd5-408f-aa4a-edd7d0751c8a tempest-VolumesImageMetadata-28597562 None] Created volume successfully.
Sep 23 15:19:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Acquiring lock "cinder-93eb16dd-a917-43dc-92a0-b095b3301456-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Lock "cinder-93eb16dd-a917-43dc-92a0-b095b3301456-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Acquiring lock "cinder-quobyte-93eb16dd-a917-43dc-92a0-b095b3301456" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Lock "cinder-quobyte-93eb16dd-a917-43dc-92a0-b095b3301456" acquired by "delete_volume" :: waited 0.019s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a991352-55a8-4e52-a40a-5aa8b8449999]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:32 devstack quobyte-client[84024]: System call of process 94403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 0 in 0.521s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 1 in 0.512s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-93eb16dd-a917-43dc-92a0-b095b3301456" returned: 0 in 0.109s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Lock "cinder-quobyte-93eb16dd-a917-43dc-92a0-b095b3301456" released by "delete_volume" :: held 1.511s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Created reservations ['1994870b-948b-448e-8fee-fe3e75e11a74', '76d42d37-d5da-4e1b-b005-bbb482356497', '840e91c1-7e7e-4558-998f-6f38f7e88ac5', '6afbc385-a8f7-486b-ba41-382af97278b6'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.132s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:19:34 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Deleted volume successfully.
Sep 23 15:19:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Flow 'volume_create_manager' (991d051b-317a-47ba-aca8-4218261ef5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3062f235-6d40-4ce2-bed6-db8a7198741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3062f235-6d40-4ce2-bed6-db8a7198741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1042816194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f146a9f9-353e-4e7a-849d-b40134194154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29225e5d7d9b44ef840be1fe7a4cd3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:34Z,use_quota=True,user_id='69bc2eab32df424ea56c274903ec5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42d040e-69af-4e40-ad22-a4aaafdfe6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42d040e-69af-4e40-ad22-a4aaafdfe6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c36408-bf54-429c-91aa-55e6870374b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c36408-bf54-429c-91aa-55e6870374b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f146a9f9-353e-4e7a-849d-b40134194154', 'volume_name': 'volume-f146a9f9-353e-4e7a-849d-b40134194154', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34e3f78-3c90-4bb5-a89a-aab16a89de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34e3f78-3c90-4bb5-a89a-aab16a89de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ef22aa-7da7-424a-bf63-2ff7fdb55898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:34 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Volume f146a9f9-353e-4e7a-849d-b40134194154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f146a9f9-353e-4e7a-849d-b40134194154', 'volume_size': 1}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1042816194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f146a9f9-353e-4e7a-849d-b40134194154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29225e5d7d9b44ef840be1fe7a4cd3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:34Z,use_quota=True,user_id='69bc2eab32df424ea56c274903ec5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Creating volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:19:34 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:19:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1ae8c4da-72e9-48b1-a842-0e96e3db3cfc tempest-VolumesImageMetadata-28597562 None] Lock "cinder-93eb16dd-a917-43dc-92a0-b095b3301456-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:35 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=40, name=volume-f146a9f9-353e-4e7a-849d-b40134194154, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 1073741824" returned: 0 in 0.472s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154" returned: 0 in 0.108s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] <== create_volume: return (634ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ef22aa-7da7-424a-bf63-2ff7fdb55898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f146a9f9-353e-4e7a-849d-b40134194154', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd067a36-5a4c-481c-8365-e718a2e570e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:35 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Volume volume-f146a9f9-353e-4e7a-849d-b40134194154 (f146a9f9-353e-4e7a-849d-b40134194154): created successfully
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd067a36-5a4c-481c-8365-e718a2e570e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Flow 'volume_create_manager' (991d051b-317a-47ba-aca8-4218261ef5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0ad8c8c7-f216-444f-a4a4-a56a7c13bfa2 tempest-SnapshotsActionsTest-1026233395 None] Created volume successfully.
Sep 23 15:19:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Creating offline snapshot 690212e9-cc61-4e6d-a0e5-7f965ba8045d of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:19:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0971be84-8d3f-4c6f-b3aa-79abd53a8481]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:38 devstack quobyte-client[84024]: System call of process 94432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154" returned: 0 in 0.493s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:38 devstack quobyte-client[84024]: System call of process 94435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:38 devstack quobyte-client[84024]: System call of process 94435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:38 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=41, name=volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d 1G" returned: 0 in 0.281s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.163s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:19:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.387s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Flow 'volume_create_manager' (a89e75ac-ebd4-4cc1-9d4b-8ba478594cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93349572-044f-44c4-a3ac-97791ece7000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.393s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93349572-044f-44c4-a3ac-97791ece7000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-647421047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45144600-5e42-4dc5-a8fa-f8be5dbdedad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604dbaf27bfb46cebf6c468468d0992e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:39Z,use_quota=True,user_id='1b397f1f29d2428f9c296026f1e8ccb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c2daee-fb24-4012-8e8d-b2467890ec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c2daee-fb24-4012-8e8d-b2467890ec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ac6e47-5ada-49a3-bee6-d794d7adcaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ac6e47-5ada-49a3-bee6-d794d7adcaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45144600-5e42-4dc5-a8fa-f8be5dbdedad', 'volume_name': 'volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f156b42-3678-4bb3-83d0-fe20a6ae8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f156b42-3678-4bb3-83d0-fe20a6ae8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38edb7ff-c97c-4470-b30a-7d1c254e1dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:40 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Volume 45144600-5e42-4dc5-a8fa-f8be5dbdedad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad', 'volume_size': 1}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.info" returned: 0 in 0.363s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.info" returned: 0 in 0.090s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-647421047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45144600-5e42-4dc5-a8fa-f8be5dbdedad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604dbaf27bfb46cebf6c468468d0992e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:19:39Z,use_quota=True,user_id='1b397f1f29d2428f9c296026f1e8ccb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Creating volume 45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:19:40 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:40 devstack quobyte-client[84024]: System call of process 94445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:40 devstack quobyte-client[84024]: System call of process 94445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:40 devstack quobyte-client[84024]: System call of process 94445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:40 devstack quobyte-client[84024]: System call of process 94445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:40 devstack quobyte-client[84024]: System call of process 94445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:40 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=43, name=volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:40 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6bc50f0b-0f4e-4b44-a726-58dac2d737d0 tempest-SnapshotsActionsTest-1026233395 None] Create snapshot completed successfully
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad 1073741824" returned: 0 in 0.423s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad" returned: 0 in 0.087s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] <== create_volume: return (573ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.600s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38edb7ff-c97c-4470-b30a-7d1c254e1dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4001ee-b6cd-4262-a452-e0d0fa066627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:19:41 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Volume volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad (45144600-5e42-4dc5-a8fa-f8be5dbdedad): created successfully
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4001ee-b6cd-4262-a452-e0d0fa066627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:19:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Flow 'volume_create_manager' (a89e75ac-ebd4-4cc1-9d4b-8ba478594cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:19:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ab483d11-0e9a-4f14-9c7f-af3d9a422311 tempest-SnapshotMetadataTestJSON-340600062 None] Created volume successfully.
Sep 23 15:19:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Creating offline snapshot 230d567b-de8a-41a8-a11c-95cfb8b1f88f of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:19:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ec22a-e07b-4794-8b99-4f84132d6649]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:43 devstack quobyte-client[84024]: System call of process 94473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.496s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:43 devstack quobyte-client[84024]: System call of process 94476 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:43 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=44, name=volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f 1G" returned: 0 in 0.271s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:43 devstack quobyte-client[84024]: System call of process 94479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:43 devstack quobyte-client[84024]: System call of process 94479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:43 devstack quobyte-client[84024]: System call of process 94479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:43 devstack quobyte-client[84024]: System call of process 94479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f" returned: 0 in 0.169s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f" returned: 0 in 0.102s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f" returned: 0 in 0.089s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.436s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.143s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Creating offline snapshot 344afb24-8846-4b51-81e1-f551ab9c1a3e of volume 45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:19:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f8c85486-fd69-4b5f-b6cc-ce37c8c1fe62 tempest-SnapshotsActionsTest-1026233395 None] Create snapshot completed successfully
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5d1c54-c778-4fd9-91e5-babd389d8f2a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:44 devstack quobyte-client[84024]: System call of process 94484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:44 devstack quobyte-client[84024]: System call of process 94484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-230d567b-de8a-41a8-a11c-95cfb8b1f88f-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad" returned: 0 in 0.619s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-230d567b-de8a-41a8-a11c-95cfb8b1f88f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.272s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:45 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=45, name=volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" acquired by "delete_snapshot" :: waited 0.048s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-230d567b-de8a-41a8-a11c-95cfb8b1f88f" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-230d567b-de8a-41a8-a11c-95cfb8b1f88f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Deleting offline snapshot 230d567b-de8a-41a8-a11c-95cfb8b1f88f of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] snapshot_file for this snap is: volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e 1G" returned: 0 in 0.352s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): qemu-img rebase -u -b volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a8151-c393-4152-9f42-abdd3033e729]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:45 devstack quobyte-client[84024]: System call of process 94490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "qemu-img rebase -u -b volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e" returned: 0 in 0.205s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e" returned: 0 in 0.138s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e" returned: 0 in 0.121s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f" returned: 0 in 0.635s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.info" returned: 0 in 0.206s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30c66b-a5d2-4328-9722-f5e9fd388daf]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.info" returned: 0 in 0.198s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-cedcbeb1-0cc6-4900-b1fd-f280992ad115 tempest-SnapshotMetadataTestJSON-340600062 None] Create snapshot completed successfully
Sep 23 15:19:46 devstack quobyte-client[84024]: System call of process 94501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:46 devstack quobyte-client[84024]: System call of process 94501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.563s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f" returned: 0 in 0.430s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.230d567b-de8a-41a8-a11c-95cfb8b1f88f" returned: 0 in 0.139s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-230d567b-de8a-41a8-a11c-95cfb8b1f88f" released by "_delete_snapshot" :: held 2.338s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" released by "delete_snapshot" :: held 2.370s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:47 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Created reservations ['bc62d9f3-80f4-4096-87ce-81d189330d90', '005363fd-d201-42a0-ac68-574e0b28a7fc', 'a447ecae-7c02-4b75-833a-800b2267d6dc', 'e7cd595b-d961-4f65-b446-cbbce557408e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "cinder-344afb24-8846-4b51-81e1-f551ab9c1a3e-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-344afb24-8846-4b51-81e1-f551ab9c1a3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "cinder-quobyte-45144600-5e42-4dc5-a8fa-f8be5dbdedad" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-quobyte-45144600-5e42-4dc5-a8fa-f8be5dbdedad" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "cinder-quobyte-344afb24-8846-4b51-81e1-f551ab9c1a3e" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Delete snapshot completed successfully.
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4f4f9286-287e-486f-9821-a2606e2bf8f7 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-230d567b-de8a-41a8-a11c-95cfb8b1f88f-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-quobyte-344afb24-8846-4b51-81e1-f551ab9c1a3e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Deleting offline snapshot 344afb24-8846-4b51-81e1-f551ab9c1a3e of volume 45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] snapshot_file for this snap is: volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af829a-c8ca-423d-af54-5edf9cefa36e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:48 devstack quobyte-client[84024]: System call of process 94510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:48 devstack quobyte-client[84024]: System call of process 94510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:48 devstack quobyte-client[84024]: System call of process 94510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e" returned: 0 in 0.385s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d113dfe-ee03-4a45-8cb0-e9d591eb8aee]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:49 devstack quobyte-client[84024]: System call of process 94513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad" returned: 0 in 0.501s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:49 devstack quobyte-client[84024]: System call of process 94516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e" returned: 0 in 0.531s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:49 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad.344afb24-8846-4b51-81e1-f551ab9c1a3e" returned: 0 in 0.343s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Creating offline snapshot e4c235cb-cf9d-45db-8ab8-39560c13e054 of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-quobyte-344afb24-8846-4b51-81e1-f551ab9c1a3e" released by "_delete_snapshot" :: held 2.123s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7486116-d9d7-455f-bb19-e3672a298165]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-quobyte-45144600-5e42-4dc5-a8fa-f8be5dbdedad" released by "delete_snapshot" :: held 2.276s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Created reservations ['087a17e3-4c01-4c4a-814b-3104587c0818', 'b47201fa-0dec-490c-9eb7-85c16c9d4790', 'aa2c0e05-53fe-4c25-8ada-97d688e4f280', '5c5ff925-189e-440e-a949-969fa761073a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.605s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:51 devstack quobyte-client[84024]: System call of process 94523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:51 devstack quobyte-client[84024]: System call of process 94523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:51 devstack quobyte-client[84024]: System call of process 94523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:51 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=47, name=volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:19:51 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Delete snapshot completed successfully.
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6b1e8a01-22ad-417f-8be2-589f875f17f5 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-344afb24-8846-4b51-81e1-f551ab9c1a3e-delete_snapshot" released by "delete_snapshot" :: held 3.332s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 1G" returned: 0 in 0.561s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:51 devstack quobyte-client[84024]: System call of process 94526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "cinder-45144600-5e42-4dc5-a8fa-f8be5dbdedad-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054" returned: 0 in 0.373s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-45144600-5e42-4dc5-a8fa-f8be5dbdedad-delete_volume" acquired by "delete_volume" :: waited 0.195s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054" returned: 0 in 0.341s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "cinder-quobyte-45144600-5e42-4dc5-a8fa-f8be5dbdedad" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054" returned: 0 in 0.398s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-quobyte-45144600-5e42-4dc5-a8fa-f8be5dbdedad" acquired by "delete_volume" :: waited 0.158s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f214a9fd-e338-46a3-8663-b4863d8727d6]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:52 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-385a14e7-79a3-4eef-a64f-53ee18abc193 tempest-SnapshotsActionsTest-1026233395 None] Create snapshot completed successfully
Sep 23 15:19:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-65c4c732-7cc8-4d8b-8e38-1d9bb6ffb290 req-fde3478f-58b5-423a-934f-8d31a7d2416e tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-65c4c732-7cc8-4d8b-8e38-1d9bb6ffb290 req-fde3478f-58b5-423a-934f-8d31a7d2416e tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-65c4c732-7cc8-4d8b-8e38-1d9bb6ffb290 req-fde3478f-58b5-423a-934f-8d31a7d2416e tempest-AttachVolumeNegativeTest-1403103512 None] Terminate volume connection completed successfully.
Sep 23 15:19:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-65c4c732-7cc8-4d8b-8e38-1d9bb6ffb290 req-fde3478f-58b5-423a-934f-8d31a7d2416e tempest-AttachVolumeNegativeTest-1403103512 None] Deleting attachment d0a9ca62-c71a-4f1a-a65d-739e1a8a9a90. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:19:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad" returned: 0 in 0.700s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-45144600-5e42-4dc5-a8fa-f8be5dbdedad" returned: 0 in 0.124s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-quobyte-45144600-5e42-4dc5-a8fa-f8be5dbdedad" released by "delete_volume" :: held 1.059s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-e4c235cb-cf9d-45db-8ab8-39560c13e054-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Created reservations ['3bf76fd5-fe24-49ca-a95c-5d955fb2ec5e', '6d879c4e-7630-42d1-8524-60dbcd984455', 'f710d3da-6119-40ce-9033-90b3f3165e79', '1600c375-0a0f-4a4e-b2dd-f7a856eb8b89'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-e4c235cb-cf9d-45db-8ab8-39560c13e054-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:54 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-e4c235cb-cf9d-45db-8ab8-39560c13e054" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-e4c235cb-cf9d-45db-8ab8-39560c13e054" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Deleting offline snapshot e4c235cb-cf9d-45db-8ab8-39560c13e054 of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] snapshot_file for this snap is: volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e658abce-03bf-49d4-a404-6cc1f02ca65c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:54 devstack quobyte-client[84024]: System call of process 94537 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.185s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:55 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:19:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Deleted volume successfully.
Sep 23 15:19:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054" returned: 0 in 0.930s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:55 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450f6f1-c9f6-4c13-9049-5e0087889b2c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6d79aaab-1704-40f8-b286-019fc2b4c089 tempest-SnapshotMetadataTestJSON-340600062 None] Lock "cinder-45144600-5e42-4dc5-a8fa-f8be5dbdedad-delete_volume" released by "delete_volume" :: held 3.596s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:56 devstack quobyte-client[84024]: System call of process 94541 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.812s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:19:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:56 devstack quobyte-client[84024]: System call of process 94545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:56 devstack quobyte-client[84024]: System call of process 94545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:19:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054" returned: 0 in 0.839s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:19:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e4c235cb-cf9d-45db-8ab8-39560c13e054" returned: 0 in 0.416s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:19:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-e4c235cb-cf9d-45db-8ab8-39560c13e054" released by "_delete_snapshot" :: held 3.569s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" released by "delete_snapshot" :: held 3.604s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:58 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Created reservations ['b7eb97b5-c093-4370-aa02-b76bb937b022', 'a36c50d7-9aa2-4464-8939-5a7fa4a7cf54', '9171a3ed-dbfb-4c0e-ac6c-f2cdfc60d08e', '7b5ab722-fac0-45e1-8dac-26a702b0913a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:19:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Delete snapshot completed successfully.
Sep 23 15:19:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a5dd6e6-8aa9-40ae-bd74-7391c2c944f1 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-e4c235cb-cf9d-45db-8ab8-39560c13e054-delete_snapshot" released by "delete_snapshot" :: held 4.341s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:19:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:19:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:19:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:19:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Creating offline snapshot 26d1bba3-65df-4b8c-9556-3195f09a2852 of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:19:59 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd72ecf-d2aa-4453-bf2c-06935d03b525]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:19:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:00 devstack quobyte-client[84024]: System call of process 94587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.810s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:00 devstack quobyte-client[84024]: System call of process 94591 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:01 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=48, name=volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 1G" returned: 0 in 0.698s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:01 devstack quobyte-client[84024]: System call of process 94595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852" returned: 0 in 0.333s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:20:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852" returned: 0 in 0.471s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Flow 'volume_create_manager' (30af9154-00e1-4fc9-a203-383103f3a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7115b64-1e44-4e52-8f11-b0e580ace81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852" returned: 0 in 0.492s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7115b64-1e44-4e52-8f11-b0e580ace81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1433486250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368a0d84-8542-4a1e-899f-0c6039df8fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b5f21860834c72b91014d65f1a807e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:02Z,use_quota=True,user_id='22430475c72d442cbf93b3fb8e4708c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceaf1bd-a831-40cd-843a-f677aa68b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceaf1bd-a831-40cd-843a-f677aa68b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a91ae3-73a6-4455-9bd7-be644040d94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a91ae3-73a6-4455-9bd7-be644040d94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368a0d84-8542-4a1e-899f-0c6039df8fe1', 'volume_name': 'volume-368a0d84-8542-4a1e-899f-0c6039df8fe1', 'volume_size': 2}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c37928-1dd5-416e-b6bd-9d40f39de0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c37928-1dd5-416e-b6bd-9d40f39de0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0660d7e4-aae8-4045-a5a4-0d634edb7de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:03 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Volume 368a0d84-8542-4a1e-899f-0c6039df8fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368a0d84-8542-4a1e-899f-0c6039df8fe1', 'volume_size': 2}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1433486250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368a0d84-8542-4a1e-899f-0c6039df8fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b5f21860834c72b91014d65f1a807e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:02Z,use_quota=True,user_id='22430475c72d442cbf93b3fb8e4708c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Creating volume 368a0d84-8542-4a1e-899f-0c6039df8fe1 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:20:03 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1 2147483648 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:03 devstack quobyte-client[84024]: System call of process 94602 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:03 devstack quobyte-client[84024]: System call of process 94602 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:03 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=49, name=volume-368a0d84-8542-4a1e-899f-0c6039df8fe1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:03 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-47d14bf4-3e0d-4d18-9e34-54ce29047cd7 tempest-SnapshotsActionsTest-1026233395 None] Create snapshot completed successfully
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1 2147483648" returned: 0 in 0.581s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1" returned: 0 in 0.100s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] <== create_volume: return (750ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:20:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0660d7e4-aae8-4045-a5a4-0d634edb7de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368a0d84-8542-4a1e-899f-0c6039df8fe1', 'volume_size': 2}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a36ce7-5a1a-4b99-bb2e-3077f73dfcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-26d1bba3-65df-4b8c-9556-3195f09a2852-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-26d1bba3-65df-4b8c-9556-3195f09a2852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:04 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:04 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Volume volume-368a0d84-8542-4a1e-899f-0c6039df8fe1 (368a0d84-8542-4a1e-899f-0c6039df8fe1): created successfully
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a36ce7-5a1a-4b99-bb2e-3077f73dfcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Flow 'volume_create_manager' (30af9154-00e1-4fc9-a203-383103f3a073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" acquired by "delete_snapshot" :: waited 0.059s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-26d1bba3-65df-4b8c-9556-3195f09a2852" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:04 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-20a4733d-4421-4275-9d79-6992f0b9a58c tempest-VolumesCloneNegativeTest-105816377 None] Created volume successfully.
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-26d1bba3-65df-4b8c-9556-3195f09a2852" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Deleting offline snapshot 26d1bba3-65df-4b8c-9556-3195f09a2852 of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] snapshot_file for this snap is: volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f5114-d569-4222-804a-8e3399db2340]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:04 devstack quobyte-client[84024]: System call of process 94606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852" returned: 0 in 0.478s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:04 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[db70b9cf-8c2a-4d54-abbd-c1e6165db5be]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:05 devstack quobyte-client[84024]: System call of process 94609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.482s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Acquiring lock "cinder-368a0d84-8542-4a1e-899f-0c6039df8fe1-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Lock "cinder-368a0d84-8542-4a1e-899f-0c6039df8fe1-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852" returned: 0 in 0.647s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:06 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Acquiring lock "cinder-quobyte-368a0d84-8542-4a1e-899f-0c6039df8fe1" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.26d1bba3-65df-4b8c-9556-3195f09a2852" returned: 0 in 0.523s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Lock "cinder-quobyte-368a0d84-8542-4a1e-899f-0c6039df8fe1" acquired by "delete_volume" :: waited 0.084s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-26d1bba3-65df-4b8c-9556-3195f09a2852" released by "_delete_snapshot" :: held 2.451s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[365e832a-7c6c-4224-938d-50efce4869e8]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" released by "delete_snapshot" :: held 2.613s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "cinder-68a2b59f-db33-441e-9fd2-86d802f3b9cb-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-68a2b59f-db33-441e-9fd2-86d802f3b9cb-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Created reservations ['341e7f31-4219-47d1-9073-a64a5d737423', '22f38484-edc0-4b57-9f74-96003664b8af', 'e5bded9a-02c3-4c54-8003-7491e3cdff23', 'f45fe93a-7a78-4d43-8e5d-c3014763dabe'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "cinder-quobyte-68a2b59f-db33-441e-9fd2-86d802f3b9cb" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-quobyte-68a2b59f-db33-441e-9fd2-86d802f3b9cb" acquired by "delete_volume" :: waited 0.037s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:07 devstack quobyte-client[84024]: System call of process 94619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[db055597-aa11-4a2c-92dc-4199ae824f0d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:08 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Delete snapshot completed successfully.
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1" returned: 0 in 1.222s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e2be9935-2600-46a3-897e-27ef6d8ff6a2 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-26d1bba3-65df-4b8c-9556-3195f09a2852-delete_snapshot" released by "delete_snapshot" :: held 3.915s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-368a0d84-8542-4a1e-899f-0c6039df8fe1" returned: 0 in 0.230s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Lock "cinder-quobyte-368a0d84-8542-4a1e-899f-0c6039df8fe1" released by "delete_volume" :: held 1.544s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:08 devstack quobyte-client[84024]: System call of process 94622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:08 devstack quobyte-client[84024]: System call of process 94622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:08 devstack quobyte-client[84024]: System call of process 94622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb" returned: 0 in 0.696s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-68a2b59f-db33-441e-9fd2-86d802f3b9cb" returned: 0 in 0.785s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-quobyte-68a2b59f-db33-441e-9fd2-86d802f3b9cb" released by "delete_volume" :: held 1.652s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.457s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:09 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Creating offline snapshot e5f7d7d9-443f-412d-bbf1-d029d171bb4f of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Created reservations ['95bb0b49-713b-47e7-bec0-6777eb50b061', 'bd234c47-0250-4d7e-ac02-29ab8ab69499', '9b8aa22e-daac-404e-9293-83a84f76a709', '828d92fa-c2e2-4d9d-bb66-b6430e8e1e5b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d7555-a73b-43a4-9213-1ecce1f27377]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Created reservations ['e665f8fc-ed45-4d75-998e-8ba57d112db0', '174fc4b3-ed43-4e96-a82b-1abcfdf18e59', '48d473e4-985e-42ac-a257-8e8aad48157e', 'dded39d7-06ac-4c68-8734-98f55a1ed562'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:10 devstack quobyte-client[84024]: System call of process 94628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.932s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:10 devstack quobyte-client[84024]: System call of process 94632 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.594s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:10 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=50, name=volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:11 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Deleted volume successfully.
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "cinder-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f 1G" returned: 0 in 1.053s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e4ba4be1-afb0-4606-b09b-7ef45918d22b tempest-VolumesCloneNegativeTest-105816377 None] Lock "cinder-368a0d84-8542-4a1e-899f-0c6039df8fe1-delete_volume" released by "delete_volume" :: held 5.831s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:11 devstack quobyte-client[84024]: System call of process 94636 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.750s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:11 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Deleted volume successfully.
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954-delete_volume" acquired by "delete_volume" :: waited 0.534s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img rebase -u -b volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f" returned: 0 in 0.507s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-70120847-dc5b-4e77-b60b-627a6f3c50b7 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-68a2b59f-db33-441e-9fd2-86d802f3b9cb-delete_volume" released by "delete_volume" :: held 4.886s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f" returned: 0 in 0.373s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "cinder-quobyte-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f" returned: 0 in 0.464s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.562s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-quobyte-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" acquired by "delete_volume" :: waited 0.111s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b5e2b-a6ec-4df6-aceb-a61b79b25f58]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-232ded5f-0d09-4ce7-a69f-884f71d81527 tempest-SnapshotsActionsTest-1026233395 None] Create snapshot completed successfully
Sep 23 15:20:13 devstack quobyte-client[84024]: System call of process 94641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" returned: 0 in 0.637s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" returned: 0 in 0.101s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-quobyte-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954" released by "delete_volume" :: held 0.940s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Created reservations ['2520ad77-d582-4f9b-a929-cfc05b42832b', '6e821a24-ef1d-4940-81ce-63a8a50ebbe0', '22d1c43e-045f-4b15-ba8b-ef807efde018', '0caeb23d-fe55-4481-a56e-d056e05e53e4'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.168s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:14 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Deleted volume successfully.
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-e5f7d7d9-443f-412d-bbf1-d029d171bb4f-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-e5f7d7d9-443f-412d-bbf1-d029d171bb4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-73a91b0e-c35d-41fe-b50e-70c1a0bd7d99 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-6d5efd94-8fb6-45ca-a9b7-29ca9fefd954-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Acquiring lock "cinder-quobyte-e5f7d7d9-443f-412d-bbf1-d029d171bb4f" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-e5f7d7d9-443f-412d-bbf1-d029d171bb4f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Deleting offline snapshot e5f7d7d9-443f-412d-bbf1-d029d171bb4f of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] snapshot_file for this snap is: volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b583fe3f-f7a6-4217-9c0d-13ca0fcf0387]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "cinder-f68cebce-6e5c-4812-80d7-80e2d224336b-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-f68cebce-6e5c-4812-80d7-80e2d224336b-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "cinder-quobyte-f68cebce-6e5c-4812-80d7-80e2d224336b" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:15 devstack quobyte-client[84024]: System call of process 94646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-quobyte-f68cebce-6e5c-4812-80d7-80e2d224336b" acquired by "delete_volume" :: waited 0.019s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f" returned: 0 in 0.690s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d1ab83-11d4-450e-a5a6-b16204c9b872]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b088cc-a981-4da9-aac1-be75174af0a0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:16 devstack quobyte-client[84024]: System call of process 94650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:20:16 devstack quobyte-client[84024]: System call of process 94651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:16 devstack quobyte-client[84024]: System call of process 94651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:16 devstack quobyte-client[84024]: System call of process 94651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Flow 'volume_create_manager' (f570222b-1453-4898-8a4a-cd32bb438d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291a1bfe-b3cd-4c74-955b-f7323d4aeb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291a1bfe-b3cd-4c74-955b-f7323d4aeb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-15679218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56260de-edf6-4436-b88e-697cad8fac6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba76cb14c1344164b63a5befe9350257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:16Z,use_quota=True,user_id='e02d5f9fe492448985f29f03a4f2c52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c413eea1-81f3-4d31-8fd1-f7f4cabc79de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c413eea1-81f3-4d31-8fd1-f7f4cabc79de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4026663c-e4e3-4cdc-8118-a4ec1e9690b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b" returned: 0 in 0.940s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.768s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:17 devstack quobyte-client[84024]: System call of process 94657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:17 devstack quobyte-client[84024]: System call of process 94657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:17 devstack quobyte-client[84024]: System call of process 94657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f68cebce-6e5c-4812-80d7-80e2d224336b" returned: 0 in 0.443s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-quobyte-f68cebce-6e5c-4812-80d7-80e2d224336b" released by "delete_volume" :: held 1.566s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f" returned: 0 in 0.639s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Created reservations ['f5b1cf03-eabb-4032-a737-94aaebd86fc7', 'cb0edfb6-f2b4-4598-85fe-794195cae902', 'b2d775b2-d85f-4270-bdf7-ba21843f6653', '7aa9d420-78d0-4390-aec7-980ba78ac0fa'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4026663c-e4e3-4cdc-8118-a4ec1e9690b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd56260de-edf6-4436-b88e-697cad8fac6f', 'volume_name': 'volume-d56260de-edf6-4436-b88e-697cad8fac6f', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e654280>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24389b44-2200-4aac-8943-25df97ed7ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24389b44-2200-4aac-8943-25df97ed7ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebf159e-0a5c-4055-9599-07cd5ec964a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Volume d56260de-edf6-4436-b88e-697cad8fac6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d56260de-edf6-4436-b88e-697cad8fac6f', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e654280>}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Cloning d56260de-edf6-4436-b88e-697cad8fac6f from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.e5f7d7d9-443f-412d-bbf1-d029d171bb4f" returned: 0 in 0.705s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-e5f7d7d9-443f-412d-bbf1-d029d171bb4f" released by "_delete_snapshot" :: held 3.364s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" released by "delete_snapshot" :: held 3.492s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:19 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Created reservations ['cd1db2ab-dbf3-4429-9ae6-f1274125ecaa', '1784195a-1a2c-44f4-8be6-0eed3e23f8c2', '1556ac4b-ec96-4fa5-91da-6d10ed49bc64', '771c8fea-069a-4ff9-8221-0241d3c82a47'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.608s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:19 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:19 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Deleted volume successfully.
Sep 23 15:20:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a1165ade-7deb-4084-83a2-e10607303e98 tempest-AttachVolumeNegativeTest-1403103512 None] Lock "cinder-f68cebce-6e5c-4812-80d7-80e2d224336b-delete_volume" released by "delete_volume" :: held 4.432s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:20 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD, size 20.69 MB, duration 1.67 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:20:20 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Image download 20.69 MB at 12.42 MB/s
Sep 23 15:20:20 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[998c7b6d-73bb-4b86-9bde-fd338f031bd6]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:20 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD
Sep 23 15:20:20 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:20:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Delete snapshot completed successfully.
Sep 23 15:20:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f9979405-754a-4989-abae-99480a329180 tempest-SnapshotsActionsTest-1839706651 None] Lock "cinder-e5f7d7d9-443f-412d-bbf1-d029d171bb4f-delete_snapshot" released by "delete_snapshot" :: held 6.299s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "cinder-690212e9-cc61-4e6d-a0e5-7f965ba8045d-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-690212e9-cc61-4e6d-a0e5-7f965ba8045d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:22 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "cinder-quobyte-690212e9-cc61-4e6d-a0e5-7f965ba8045d" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-quobyte-690212e9-cc61-4e6d-a0e5-7f965ba8045d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Deleting offline snapshot 690212e9-cc61-4e6d-a0e5-7f965ba8045d of volume f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] snapshot_file for this snap is: volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9911888b-ad47-43c4-a00f-fdcc5660d12d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:23 devstack quobyte-client[84024]: System call of process 94698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.924s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f146a9f9-353e-4e7a-849d-b40134194154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:23 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Sep 23 15:20:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD" returned: 0 in 3.120s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:23 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 is fetched for user e02d5f9fe492448985f29f03a4f2c52b. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:20:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[532927cd-fac8-4073-bfd3-3a0654ac68e7]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:24 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad0d9c-71c6-494e-82d7-38e3b2e602d0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154" returned: 0 in 1.114s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:24 devstack quobyte-client[84024]: System call of process 94707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:24 devstack sudo[94706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD
Sep 23 15:20:24 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:20:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.386s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154.690212e9-cc61-4e6d-a0e5-7f965ba8045d" returned: 0 in 0.144s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-quobyte-690212e9-cc61-4e6d-a0e5-7f965ba8045d" released by "_delete_snapshot" :: held 3.083s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" released by "delete_snapshot" :: held 3.118s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Created reservations ['2d50ebae-bdca-41e7-accb-984fb78a889b', '1fc9fa51-513e-459e-8cd4-4a16607472cb', '48bb9d43-6d01-469f-b658-0120c6a6093e', '87e5bfa0-dbfa-4993-b01b-6769cd01e661'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:25 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Delete snapshot completed successfully.
Sep 23 15:20:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-df5b2784-e2f3-4a56-a2bd-8c5b9fc49572 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-690212e9-cc61-4e6d-a0e5-7f965ba8045d-delete_snapshot" released by "delete_snapshot" :: held 3.753s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "cinder-f146a9f9-353e-4e7a-849d-b40134194154-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-f146a9f9-353e-4e7a-849d-b40134194154-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:26 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" acquired by "delete_volume" :: waited 0.021s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[25800be4-2706-4ef0-87c6-1fea19a8d014]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:27 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD" returned: 0 in 3.526s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-15679218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56260de-edf6-4436-b88e-697cad8fac6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba76cb14c1344164b63a5befe9350257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:16Z,use_quota=True,user_id='e02d5f9fe492448985f29f03a4f2c52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Creating volume d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:20:28 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:28 devstack quobyte-client[84024]: System call of process 94722 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:28 devstack quobyte-client[84024]: System call of process 94725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:28 devstack quobyte-client[84024]: System call of process 94725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154" returned: 0 in 1.188s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:28 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=51, name=volume-d56260de-edf6-4436-b88e-697cad8fac6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f146a9f9-353e-4e7a-849d-b40134194154" returned: 0 in 0.180s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-quobyte-f146a9f9-353e-4e7a-849d-b40134194154" released by "delete_volume" :: held 1.731s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f 1073741824" returned: 0 in 0.994s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 0 in 0.553s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] <== create_volume: return (1668ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Created reservations ['5cbadc47-78bb-4440-b008-bfd49c726365', '3845def8-4b8a-4e55-8f00-66d60e3ccbda', '417c66b5-4be7-4375-8e4c-88f7bab5f506', '02377d86-4352-4c05-b60e-e1d6b822fb6b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:29 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Attempting download of 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume d56260de-edf6-4436-b88e-697cad8fac6f. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a899730-b687-46be-b514-30f4d0a8a4cf]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_ob12__k9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.296s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Deleted volume successfully.
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=95,cinder:INSERT=40,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:20:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac886581-ba28-474f-ba31-92aa6df207e7 tempest-SnapshotsActionsTest-1026233395 None] Lock "cinder-f146a9f9-353e-4e7a-849d-b40134194154-delete_volume" released by "delete_volume" :: held 4.203s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_ob12__k9" returned: 0 in 0.950s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_ob12__k9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_ob12__k9" returned: 1 in 0.550s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_ob12__k9' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:20:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb5672-1705-4f07-9733-3656823a86fa]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:32 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] 26f34a6e-cf6d-4d01-b96a-d62e819357f3 was qcow2, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:20:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:32 devstack quobyte-client[84024]: System call of process 94741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:32 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=51, name=volume-d56260de-edf6-4436-b88e-697cad8fac6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:33 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=108,cinder:SELECT=73,cinder:INSERT=25,cinder:DELETE=7 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 0 in 1.615s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_eivp7c3ddevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:20:34 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Converted 112.00 MB image at 69.06 MB/s
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Flow 'volume_create_manager' (f5f76823-ed83-43a7-9673-e9748b74e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a4a56d-cefe-4b41-b1b4-c6ad40f41ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a4a56d-cefe-4b41-b1b4-c6ad40f41ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-858576873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd063fab-3f28-414d-ab9c-a5e35034f627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97f00b934f1455db7f11d03a7b7f03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:34Z,use_quota=True,user_id='0ba259a78c7e4a819fa28bb0ce9c8c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8508a374-a451-4454-bc78-f2fe1d81958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8508a374-a451-4454-bc78-f2fe1d81958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d36fac9-c5d2-47d4-bfaf-eed0cc2d1bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d36fac9-c5d2-47d4-bfaf-eed0cc2d1bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd063fab-3f28-414d-ab9c-a5e35034f627', 'volume_name': 'volume-fd063fab-3f28-414d-ab9c-a5e35034f627', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9810bfaa-80af-4c5c-a643-22f4086e5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9810bfaa-80af-4c5c-a643-22f4086e5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fb6557-ca0b-467d-bdda-46d9e7233f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:34 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Volume fd063fab-3f28-414d-ab9c-a5e35034f627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd063fab-3f28-414d-ab9c-a5e35034f627', 'volume_size': 1}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-858576873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd063fab-3f28-414d-ab9c-a5e35034f627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97f00b934f1455db7f11d03a7b7f03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:34Z,use_quota=True,user_id='0ba259a78c7e4a819fa28bb0ce9c8c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Creating volume fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:20:34 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:34 devstack quobyte-client[84024]: System call of process 94751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:34 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=52, name=volume-fd063fab-3f28-414d-ab9c-a5e35034f627, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f 1G" returned: 0 in 0.825s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b655428-e9df-4119-a83e-8a29c7eeb444]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 1073741824" returned: 0 in 0.602s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627" returned: 0 in 0.130s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] <== create_volume: return (836ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 0 in 0.705s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fb6557-ca0b-467d-bdda-46d9e7233f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd063fab-3f28-414d-ab9c-a5e35034f627', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:35 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984fef53-1d1e-4670-abdd-0a6efc1679fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:36 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Volume volume-fd063fab-3f28-414d-ab9c-a5e35034f627 (fd063fab-3f28-414d-ab9c-a5e35034f627): created successfully
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984fef53-1d1e-4670-abdd-0a6efc1679fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Flow 'volume_create_manager' (f5f76823-ed83-43a7-9673-e9748b74e85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-e0d3b382-2762-4095-8508-0a277baf984b req-24d474ef-c1d8-4671-8fbc-ef9fb1832ffc tempest-VolumesSnapshotsTestJSON-846885166 None] Created volume successfully.
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 1 in 0.637s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Downloaded image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume d56260de-edf6-4436-b88e-697cad8fac6f successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 for user e02d5f9fe492448985f29f03a4f2c52b is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Marking volume d56260de-edf6-4436-b88e-697cad8fac6f as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Copying metadata from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 to d56260de-edf6-4436-b88e-697cad8fac6f. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Creating volume glance metadata for volume d56260de-edf6-4436-b88e-697cad8fac6f backed by image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebf159e-0a5c-4055-9599-07cd5ec964a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56260de-edf6-4436-b88e-697cad8fac6f', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e654280>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b565fd-a599-4d8e-b949-5206a1353fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:36 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Volume volume-d56260de-edf6-4436-b88e-697cad8fac6f (d56260de-edf6-4436-b88e-697cad8fac6f): created successfully
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b565fd-a599-4d8e-b949-5206a1353fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:36 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Flow 'volume_create_manager' (f570222b-1453-4898-8a4a-cd32bb438d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-dd767a8b-8eee-48fa-82f3-298ee626a0e3 tempest-VolumesExtendTest-281980405 None] Created volume successfully.
Sep 23 15:20:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Creating offline snapshot 22da027a-eee9-4ff4-abb4-a0c15dc743c3 of volume fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:20:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c3252-5f57-430d-a98a-1fbd7b666493]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:38 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:38 devstack quobyte-client[84024]: System call of process 94761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:38 devstack quobyte-client[84024]: System call of process 94761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627" returned: 0 in 0.676s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:38 devstack quobyte-client[84024]: System call of process 94764 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:38 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=53, name=volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 1G" returned: 0 in 0.305s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): qemu-img rebase -u -b volume-fd063fab-3f28-414d-ab9c-a5e35034f627 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:38 devstack quobyte-client[84024]: System call of process 94767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:38 devstack quobyte-client[84024]: System call of process 94767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "qemu-img rebase -u -b volume-fd063fab-3f28-414d-ab9c-a5e35034f627 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3" returned: 0 in 0.249s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3" returned: 0 in 0.085s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3" returned: 0 in 0.093s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.info" returned: 0 in 0.102s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.info" returned: 0 in 0.086s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.386s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df3d1a7-9c4c-497b-be30-f1db6de6263b]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:39 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-76238d3b-237c-4af9-b1d0-786eeae43f4c req-5c2dfd41-f31e-4440-81f0-2c2946943fb1 tempest-VolumesSnapshotsTestJSON-846885166 None] Create snapshot completed successfully
Sep 23 15:20:40 devstack quobyte-client[84024]: System call of process 94774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:40 devstack quobyte-client[84024]: System call of process 94774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:40 devstack quobyte-client[84024]: System call of process 94774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:40 devstack quobyte-client[84024]: System call of process 94774 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 0 in 0.625s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 1 in 0.535s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:20:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f 2G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:41 devstack quobyte-client[84024]: System call of process 94779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:41 devstack quobyte-client[84024]: System call of process 94779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "cinder-22da027a-eee9-4ff4-abb4-a0c15dc743c3-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f 2G" returned: 0 in 0.592s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.970s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-22da027a-eee9-4ff4-abb4-a0c15dc743c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.256s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:41 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "cinder-quobyte-fd063fab-3f28-414d-ab9c-a5e35034f627" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-quobyte-fd063fab-3f28-414d-ab9c-a5e35034f627" acquired by "delete_snapshot" :: waited 0.073s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "cinder-quobyte-22da027a-eee9-4ff4-abb4-a0c15dc743c3" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-quobyte-22da027a-eee9-4ff4-abb4-a0c15dc743c3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Deleting offline snapshot 22da027a-eee9-4ff4-abb4-a0c15dc743c3 of volume fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] snapshot_file for this snap is: volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ede42cd-9a29-416c-bc7f-6a47dd5b1fe0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5d590364-81d7-4ad8-ab15-02fae40876ab tempest-VolumesExtendTest-281980405 None] Extend volume completed successfully.
Sep 23 15:20:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3" returned: 0 in 0.453s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd063fab-3f28-414d-ab9c-a5e35034f627(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:20:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db86356-f83d-4938-9295-a68b7220672f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:42 devstack quobyte-client[84024]: System call of process 94785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627" returned: 0 in 0.510s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:43 devstack quobyte-client[84024]: System call of process 94788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:43 devstack quobyte-client[84024]: System call of process 94788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:43 devstack quobyte-client[84024]: System call of process 94788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:43 devstack quobyte-client[84024]: System call of process 94788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-d56260de-edf6-4436-b88e-697cad8fac6f-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3" returned: 0 in 0.443s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Lock "cinder-d56260de-edf6-4436-b88e-697cad8fac6f-delete_volume" acquired by "delete_volume" :: waited 0.282s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627.22da027a-eee9-4ff4-abb4-a0c15dc743c3" returned: 0 in 0.400s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-quobyte-22da027a-eee9-4ff4-abb4-a0c15dc743c3" released by "_delete_snapshot" :: held 2.081s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-quobyte-fd063fab-3f28-414d-ab9c-a5e35034f627" released by "delete_snapshot" :: held 2.142s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:43 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-quobyte-d56260de-edf6-4436-b88e-697cad8fac6f" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-d56260de-edf6-4436-b88e-697cad8fac6f" acquired by "delete_volume" :: waited 0.039s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ee8ca-62b2-4904-b160-99cec5a689fa]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:44 devstack cinder-volume[84009]: DEBUG cinder.quota [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Created reservations ['f660ba53-6944-49a0-9c60-ae57934f84bd', '7086fa01-11ad-4310-b409-07145f4c4f54', '27a1b96e-9ee6-46b4-b42b-fe654f680bf6', '811f642e-0221-40fe-ab23-3bc66265a491'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Delete snapshot completed successfully.
Sep 23 15:20:44 devstack quobyte-client[84024]: System call of process 94792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-506599da-1f05-45cb-85cf-95a0b069b241 req-cf50f189-03b7-4d8d-92c4-9af59e9bb3e7 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-22da027a-eee9-4ff4-abb4-a0c15dc743c3-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 0 in 0.650s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "cinder-fd063fab-3f28-414d-ab9c-a5e35034f627-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-fd063fab-3f28-414d-ab9c-a5e35034f627-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:45 devstack quobyte-client[84024]: System call of process 94794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:45 devstack quobyte-client[84024]: System call of process 94794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 1 in 0.713s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "cinder-quobyte-fd063fab-3f28-414d-ab9c-a5e35034f627" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d56260de-edf6-4436-b88e-697cad8fac6f" returned: 0 in 0.289s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-quobyte-fd063fab-3f28-414d-ab9c-a5e35034f627" acquired by "delete_volume" :: waited 0.143s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-d56260de-edf6-4436-b88e-697cad8fac6f" released by "delete_volume" :: held 1.889s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9ebf01-5e5e-4699-873f-580f252f37c2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:46 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Created reservations ['12ff3d56-4f8e-462f-9dd0-97c91f1afe5d', '776be67d-3534-4a6a-8b83-ecdf5c2b355e', 'eb0a66a1-3262-417e-b4a6-a84882c2610b', '72b161fa-c4fd-4032-9212-f73886bba75f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:46 devstack quobyte-client[84024]: System call of process 94799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:46 devstack quobyte-client[84024]: System call of process 94799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627" returned: 0 in 0.707s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fd063fab-3f28-414d-ab9c-a5e35034f627" returned: 0 in 0.277s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-quobyte-fd063fab-3f28-414d-ab9c-a5e35034f627" released by "delete_volume" :: held 1.362s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.423s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Deleted volume successfully.
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG cinder.quota [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Created reservations ['443cf979-1c74-45db-97af-cb0139f9317f', '325d2ac5-a2ea-4cf6-97e6-5bba24bdb448', '019364e9-6d8e-4c1a-baf8-8583e3aa9f01', 'ba7d2eab-afbc-41a1-8682-3bc514c2331f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-922d97cb-b780-489a-9e57-9f4284e64d0a tempest-VolumesExtendTest-281980405 None] Lock "cinder-d56260de-edf6-4436-b88e-697cad8fac6f-delete_volume" released by "delete_volume" :: held 4.403s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.131s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG cinder.manager [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:20:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Deleted volume successfully.
Sep 23 15:20:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Flow 'volume_create_manager' (4921ecc6-cc20-4b97-b6be-d2f9eb5ce507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec95bd91-1e65-44f1-817b-698255755f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec95bd91-1e65-44f1-817b-698255755f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1244629408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736f2a4c-c945-4e87-900f-b06e83ceec3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba76cb14c1344164b63a5befe9350257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:48Z,use_quota=True,user_id='e02d5f9fe492448985f29f03a4f2c52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94a75a3-ee7a-46ae-9626-a9410624bab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94a75a3-ee7a-46ae-9626-a9410624bab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565d04a1-20df-40b1-add0-5445e86b7757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565d04a1-20df-40b1-add0-5445e86b7757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736f2a4c-c945-4e87-900f-b06e83ceec3f', 'volume_name': 'volume-736f2a4c-c945-4e87-900f-b06e83ceec3f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315f5fd7-1d53-4eb4-a81f-16cbc76da813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315f5fd7-1d53-4eb4-a81f-16cbc76da813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8759402c-ee77-4e23-b32c-aae6f68813dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:49 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Volume 736f2a4c-c945-4e87-900f-b06e83ceec3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736f2a4c-c945-4e87-900f-b06e83ceec3f', 'volume_size': 1}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1244629408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736f2a4c-c945-4e87-900f-b06e83ceec3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba76cb14c1344164b63a5befe9350257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:48Z,use_quota=True,user_id='e02d5f9fe492448985f29f03a4f2c52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Creating volume 736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:20:49 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-880f9437-4055-452d-a577-4aef0e14ed8a req-759a3a7f-7acc-4e65-bade-6320d15df1f9 tempest-VolumesSnapshotsTestJSON-846885166 None] Lock "cinder-fd063fab-3f28-414d-ab9c-a5e35034f627-delete_volume" released by "delete_volume" :: held 4.213s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:49 devstack quobyte-client[84024]: System call of process 94807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:49 devstack quobyte-client[84024]: System call of process 94807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:49 devstack quobyte-client[84024]: System call of process 94807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:49 devstack quobyte-client[84024]: System call of process 94807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:49 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=55, name=volume-736f2a4c-c945-4e87-900f-b06e83ceec3f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f 1073741824" returned: 0 in 0.610s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f" returned: 0 in 0.180s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] <== create_volume: return (871ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:20:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8759402c-ee77-4e23-b32c-aae6f68813dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736f2a4c-c945-4e87-900f-b06e83ceec3f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3675b3-d6a7-48c1-adf7-d432b6bb3411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Volume volume-736f2a4c-c945-4e87-900f-b06e83ceec3f (736f2a4c-c945-4e87-900f-b06e83ceec3f): created successfully
Sep 23 15:20:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3675b3-d6a7-48c1-adf7-d432b6bb3411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Flow 'volume_create_manager' (4921ecc6-cc20-4b97-b6be-d2f9eb5ce507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e8cdcd3-5623-4fb2-8477-d9621f207c52 tempest-VolumesExtendTest-281980405 None] Created volume successfully.
Sep 23 15:20:51 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Creating offline snapshot ba9800d9-3135-4708-b934-a2d092519cee of volume 736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:20:51 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[42825265-c7f5-4e2a-8330-141adaa7b967]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:51 devstack quobyte-client[84024]: System call of process 94811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f" returned: 0 in 0.603s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:51 devstack quobyte-client[84024]: System call of process 94811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:51 devstack quobyte-client[84024]: System call of process 94811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:51 devstack quobyte-client[84024]: System call of process 94811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack quobyte-client[84024]: System call of process 94815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack quobyte-client[84024]: System call of process 94815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack quobyte-client[84024]: System call of process 94815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=56, name=volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee 1G" returned: 0 in 0.352s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-736f2a4c-c945-4e87-900f-b06e83ceec3f -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:52 devstack quobyte-client[84024]: System call of process 94819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack quobyte-client[84024]: System call of process 94819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img rebase -u -b volume-736f2a4c-c945-4e87-900f-b06e83ceec3f -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee" returned: 0 in 0.239s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee" returned: 0 in 0.142s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee" returned: 0 in 0.202s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.info" returned: 0 in 0.142s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.info" returned: 0 in 0.207s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:54 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Flow 'volume_create_manager' (a55d247e-209a-42b1-a71b-fd32e6f57235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04b943a-ed87-4006-b2b0-24bfc693f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1efc4d2d-350f-4afc-9b63-bf1a45324d36 tempest-VolumesExtendTest-281980405 None] Create snapshot completed successfully
Sep 23 15:20:54 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Flow 'volume_create_manager' (a38f8075-bd2d-4d16-875e-bb8489d6e460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657a8b35-3129-443d-8ca6-17f7dd3b9fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04b943a-ed87-4006-b2b0-24bfc693f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-653897747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ec39f0-4fbf-4652-bc9d-c8a13cfb471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1444bfff73f94e9fa7e964e2cfc88f72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:54Z,use_quota=True,user_id='8b4fcb8d00e643e5836ab63dc429732e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a44ea89-ede1-4405-9271-82d1d1cd79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a44ea89-ede1-4405-9271-82d1d1cd79ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c59e4f2-799d-4e20-9725-50293e9c4d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c59e4f2-799d-4e20-9725-50293e9c4d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ec39f0-4fbf-4652-bc9d-c8a13cfb471a', 'volume_name': 'volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5067da69-350a-486e-bce6-7ab543e604e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5067da69-350a-486e-bce6-7ab543e604e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483389d-95cd-4f5a-9113-fa0031936f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume 16ec39f0-4fbf-4652-bc9d-c8a13cfb471a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a', 'volume_size': 1}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-653897747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ec39f0-4fbf-4652-bc9d-c8a13cfb471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1444bfff73f94e9fa7e964e2cfc88f72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:54Z,use_quota=True,user_id='8b4fcb8d00e643e5836ab63dc429732e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Creating volume 16ec39f0-4fbf-4652-bc9d-c8a13cfb471a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:20:54 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:54 devstack quobyte-client[84024]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:54 devstack quobyte-client[84024]: System call of process 94826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:54 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=58, name=volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657a8b35-3129-443d-8ca6-17f7dd3b9fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1011472196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72590d09-dbfe-4954-aa88-8b5c2f7f4e4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd7bdb0b24843aea5b829bc830b0257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:54Z,use_quota=True,user_id='2ce281a21d504edbacf136f9fd10589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2757131-33f9-4e97-90b0-400e36b6b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2757131-33f9-4e97-90b0-400e36b6b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa244f00-40c3-4ef5-a4ad-05dc158ea8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa244f00-40c3-4ef5-a4ad-05dc158ea8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72590d09-dbfe-4954-aa88-8b5c2f7f4e4c', 'volume_name': 'volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759f2092-065c-4da0-aedf-133588d4a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759f2092-065c-4da0-aedf-133588d4a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4778c488-50d8-417d-ae4d-2f8f8dc63464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:54 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Volume 72590d09-dbfe-4954-aa88-8b5c2f7f4e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c', 'volume_size': 1}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a 1073741824" returned: 0 in 0.540s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a" returned: 0 in 0.116s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] <== create_volume: return (718ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1011472196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72590d09-dbfe-4954-aa88-8b5c2f7f4e4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ebd7bdb0b24843aea5b829bc830b0257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:20:54Z,use_quota=True,user_id='2ce281a21d504edbacf136f9fd10589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Creating volume 72590d09-dbfe-4954-aa88-8b5c2f7f4e4c {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:20:55 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:55 devstack quobyte-client[84024]: System call of process 94830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:55 devstack quobyte-client[84024]: System call of process 94830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:55 devstack quobyte-client[84024]: System call of process 94830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:55 devstack quobyte-client[84024]: System call of process 94830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:55 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=59, name=volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1483389d-95cd-4f5a-9113-fa0031936f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ba4148-6d37-402b-825c-ef3f5e32c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c 1073741824" returned: 0 in 0.429s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:55 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a (16ec39f0-4fbf-4652-bc9d-c8a13cfb471a): created successfully
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ba4148-6d37-402b-825c-ef3f5e32c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Flow 'volume_create_manager' (a55d247e-209a-42b1-a71b-fd32e6f57235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c" returned: 0 in 0.384s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.686s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:56 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e998e11-ca98-4ace-9558-028fe7db61e8 tempest-VolumeQuotasAdminTestJSON-209309122 None] Created volume successfully.
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceebd8e-2050-43bf-bbd8-3f4d7d9fb6d7]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "cinder-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4778c488-50d8-417d-ae4d-2f8f8dc63464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae85cb-ffd2-40f6-be8c-57ff33c8d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:20:56 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Volume volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c (72590d09-dbfe-4954-aa88-8b5c2f7f4e4c): created successfully
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ae85cb-ffd2-40f6-be8c-57ff33c8d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Flow 'volume_create_manager' (a38f8075-bd2d-4d16-875e-bb8489d6e460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:20:56 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-ab62be17-ec37-499f-9d73-42044f1ae8d4 req-7bea2f18-a17f-47eb-a727-a4d11e14918e tempest-VolumesGetTestJSON-621876653 None] Created volume successfully.
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "cinder-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a-delete_volume" acquired by "delete_volume" :: waited 0.521s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:56 devstack quobyte-client[84024]: System call of process 94835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "cinder-quobyte-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "cinder-quobyte-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a" acquired by "delete_volume" :: waited 0.019s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f" returned: 0 in 0.672s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee 2G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[997448fb-7f01-43e2-b6a8-976241f85617]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:57 devstack quobyte-client[84024]: System call of process 94838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee 2G" returned: 0 in 0.344s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.212s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Acquiring lock "cinder-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f1731c70-c31a-4541-8450-351bd7d0e23d tempest-VolumesExtendTest-281980405 None] Extend volume completed successfully.
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Lock "cinder-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:57 devstack quobyte-client[84024]: System call of process 94840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:57 devstack quobyte-client[84024]: System call of process 94840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:20:57 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Acquiring lock "cinder-quobyte-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a" returned: 0 in 0.875s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Lock "cinder-quobyte-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c" acquired by "delete_volume" :: waited 0.124s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b59cc5-7cbd-4749-8166-d5975c927e23]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a" returned: 0 in 0.252s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "cinder-quobyte-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a" released by "delete_volume" :: held 1.506s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-ba9800d9-3135-4708-b934-a2d092519cee-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Lock "cinder-ba9800d9-3135-4708-b934-a2d092519cee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:58 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-quobyte-736f2a4c-c945-4e87-900f-b06e83ceec3f" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c" returned: 0 in 0.712s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-736f2a4c-c945-4e87-900f-b06e83ceec3f" acquired by "delete_snapshot" :: waited 0.163s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-quobyte-ba9800d9-3135-4708-b934-a2d092519cee" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Created reservations ['f3eafc64-ccaa-452e-ab09-46111b74ef9f', '626a702c-edfb-4163-9605-13987fe82ba3', '713d3ad6-f5d6-48ea-aed8-65fecb93063b', '2cf69be1-cb21-4afd-ad99-88bc3caadb11'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c" returned: 0 in 0.344s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-ba9800d9-3135-4708-b934-a2d092519cee" acquired by "_delete_snapshot" :: waited 0.215s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Deleting offline snapshot ba9800d9-3135-4708-b934-a2d092519cee of volume 736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] snapshot_file for this snap is: volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Lock "cinder-quobyte-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c" released by "delete_volume" :: held 1.220s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb382bed-eb68-490f-8e54-1f4c25838bc4]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.054s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:20:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.433s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee" returned: 0 in 1.008s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:00 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Deleted volume successfully.
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-736f2a4c-c945-4e87-900f-b06e83ceec3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[46478dd7-392d-4575-9a11-e704f0f79974]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-937a1e25-3d6d-4026-a03f-9b7750639299 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "cinder-16ec39f0-4fbf-4652-bc9d-c8a13cfb471a-delete_volume" released by "delete_volume" :: held 4.138s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:00 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:00 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Flow 'volume_create_manager' (24b0db91-136f-4f63-af09-1d420d7be987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b315ba5-866e-4c64-9b0f-dbdd8fbaa574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.quota [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Created reservations ['32c24311-ca4d-4bfc-8c29-c3efe8214f19', 'a76a12b6-f3ed-49e5-befe-5c6202f4b4cd', '8d7d1743-f5a9-4a72-89a9-e2bb1e3304a9', 'ff3e7525-4a98-4c47-8db8-97c1b2fadaf5'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:01 devstack quobyte-client[84024]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:01 devstack quobyte-client[84024]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:01 devstack quobyte-client[84024]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:01 devstack quobyte-client[84024]: System call of process 94853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b315ba5-866e-4c64-9b0f-dbdd8fbaa574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2137198843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db70d855-b898-45f6-b6bf-7774d15621ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1444bfff73f94e9fa7e964e2cfc88f72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:00Z,use_quota=True,user_id='8b4fcb8d00e643e5836ab63dc429732e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31953ab4-2d3f-4c51-8eb5-6e0447b38148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31953ab4-2d3f-4c51-8eb5-6e0447b38148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfc156a-fb1d-4428-af15-f2681d9dc770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfc156a-fb1d-4428-af15-f2681d9dc770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db70d855-b898-45f6-b6bf-7774d15621ae', 'volume_name': 'volume-db70d855-b898-45f6-b6bf-7774d15621ae', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949926ff-fabf-4f16-a779-ca220d395538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949926ff-fabf-4f16-a779-ca220d395538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13046438-1229-4fe1-8387-3a08ed2ec6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:01 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume db70d855-b898-45f6-b6bf-7774d15621ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db70d855-b898-45f6-b6bf-7774d15621ae', 'volume_size': 1}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2137198843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db70d855-b898-45f6-b6bf-7774d15621ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1444bfff73f94e9fa7e964e2cfc88f72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:00Z,use_quota=True,user_id='8b4fcb8d00e643e5836ab63dc429732e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Creating volume db70d855-b898-45f6-b6bf-7774d15621ae {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:01 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:01 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=60, name=volume-db70d855-b898-45f6-b6bf-7774d15621ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.040s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f" returned: 0 in 1.288s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae 1073741824" returned: 0 in 0.604s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:02 devstack quobyte-client[84024]: System call of process 94860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:02 devstack quobyte-client[84024]: System call of process 94860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:02 devstack quobyte-client[84024]: System call of process 94860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.537s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG cinder.manager [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:02 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Deleted volume successfully.
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae" returned: 0 in 0.480s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] <== create_volume: return (1171ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee" returned: 0 in 0.667s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-d75d568a-06ef-4dad-8e93-a770e7df5e12 req-2af1c933-bbb4-46e4-8752-39714ad82064 tempest-VolumesGetTestJSON-621876653 None] Lock "cinder-72590d09-dbfe-4954-aa88-8b5c2f7f4e4c-delete_volume" released by "delete_volume" :: held 4.970s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13046438-1229-4fe1-8387-3a08ed2ec6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db70d855-b898-45f6-b6bf-7774d15621ae', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb7674f-5238-465b-b62d-2e332f803878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f.ba9800d9-3135-4708-b934-a2d092519cee" returned: 0 in 0.469s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-ba9800d9-3135-4708-b934-a2d092519cee" released by "_delete_snapshot" :: held 3.848s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-736f2a4c-c945-4e87-900f-b06e83ceec3f" released by "delete_snapshot" :: held 4.103s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:03 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Volume volume-db70d855-b898-45f6-b6bf-7774d15621ae (db70d855-b898-45f6-b6bf-7774d15621ae): created successfully
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb7674f-5238-465b-b62d-2e332f803878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Flow 'volume_create_manager' (24b0db91-136f-4f63-af09-1d420d7be987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:03 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1dbdaf2b-f91e-49ef-ba89-ff295a1fea86 tempest-VolumeQuotasAdminTestJSON-209309122 None] Created volume successfully.
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Created reservations ['89dce947-58bb-453e-a9bf-b5702367c9c2', '9dc1a7f0-0d20-4554-bf0d-c6781ecc780c', '4cf1215e-03db-42fa-839d-f394d99aee31', 'e4d9f3df-81be-439e-8b3c-cd361c3f7492'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:03 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Delete snapshot completed successfully.
Sep 23 15:21:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f71058f9-d2e6-41e0-ab2c-b3f796ecc1c1 tempest-VolumesExtendTest-281980405 None] Lock "cinder-ba9800d9-3135-4708-b934-a2d092519cee-delete_snapshot" released by "delete_snapshot" :: held 4.917s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-736f2a4c-c945-4e87-900f-b06e83ceec3f-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Lock "cinder-736f2a4c-c945-4e87-900f-b06e83ceec3f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:04 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Acquiring lock "cinder-quobyte-736f2a4c-c945-4e87-900f-b06e83ceec3f" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-736f2a4c-c945-4e87-900f-b06e83ceec3f" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:04 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc708d8-2db4-4bc3-95f3-c4f49a626a44]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:05 devstack quobyte-client[84024]: System call of process 94865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:05 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a5215bcf-f5bf-4c99-8dea-1fdc750a5986 tempest-VolumeQuotasAdminTestJSON-1826455794 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a5215bcf-f5bf-4c99-8dea-1fdc750a5986 tempest-VolumeQuotasAdminTestJSON-1826455794 None] Transfer volume completed successfully.
Sep 23 15:21:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f" returned: 0 in 0.769s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-736f2a4c-c945-4e87-900f-b06e83ceec3f" returned: 0 in 0.192s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Lock "cinder-quobyte-736f2a4c-c945-4e87-900f-b06e83ceec3f" released by "delete_volume" :: held 1.183s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:05 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Created reservations ['39678872-eea5-4726-aa61-e53babd51822', '1e3cfaf2-f8a3-414b-8e7d-eed4d33fa715', '632256a8-9a8e-4193-ac80-65d36b4b7e46', 'e51f996e-c6ff-45aa-9d2f-3435a253216d'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Acquiring lock "cinder-db70d855-b898-45f6-b6bf-7774d15621ae-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.485s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Lock "cinder-db70d855-b898-45f6-b6bf-7774d15621ae-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:06 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Flow 'volume_create_manager' (fea6e9af-2f5f-4b16-a42c-820929fad960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c661717e-e859-4ec9-9c9c-f2663395b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:06 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Deleted volume successfully.
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c661717e-e859-4ec9-9c9c-f2663395b8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1808402620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2739de-828e-41c5-8339-1260bafc0e23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7310c5daa3d54a67a95c0b0140cce46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:06Z,use_quota=True,user_id='32e024be4e144b13a6cb82617ae093bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668d50ef-e33b-460c-b63f-77342708db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668d50ef-e33b-460c-b63f-77342708db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5be4a1c-9b87-4ef0-aa5f-291b14591017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5be4a1c-9b87-4ef0-aa5f-291b14591017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2739de-828e-41c5-8339-1260bafc0e23', 'volume_name': 'volume-0e2739de-828e-41c5-8339-1260bafc0e23', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40ff193-a00f-46f8-9f07-b41c2ca62ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40ff193-a00f-46f8-9f07-b41c2ca62ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420049e7-6f8a-4a97-8d6d-36ed590e98cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:06 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Volume 0e2739de-828e-41c5-8339-1260bafc0e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2739de-828e-41c5-8339-1260bafc0e23', 'volume_size': 1}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1808402620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2739de-828e-41c5-8339-1260bafc0e23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7310c5daa3d54a67a95c0b0140cce46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:06Z,use_quota=True,user_id='32e024be4e144b13a6cb82617ae093bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Creating volume 0e2739de-828e-41c5-8339-1260bafc0e23 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:06 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:07 devstack quobyte-client[84024]: System call of process 94871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:07 devstack quobyte-client[84024]: System call of process 94871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:07 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=61, name=volume-0e2739de-828e-41c5-8339-1260bafc0e23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-106e91e1-1052-447e-96ec-282fe9605efc tempest-VolumesExtendTest-281980405 None] Lock "cinder-736f2a4c-c945-4e87-900f-b06e83ceec3f-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Acquiring lock "cinder-quobyte-db70d855-b898-45f6-b6bf-7774d15621ae" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23 1073741824" returned: 0 in 0.682s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Lock "cinder-quobyte-db70d855-b898-45f6-b6bf-7774d15621ae" acquired by "delete_volume" :: waited 0.270s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23" returned: 0 in 0.320s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] <== create_volume: return (1044ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c11034-15f9-4399-9d5a-41dcb6a96fb6]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420049e7-6f8a-4a97-8d6d-36ed590e98cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2739de-828e-41c5-8339-1260bafc0e23', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a6a3c-02dd-4d10-8817-6a6b87fad196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Volume volume-0e2739de-828e-41c5-8339-1260bafc0e23 (0e2739de-828e-41c5-8339-1260bafc0e23): created successfully
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a6a3c-02dd-4d10-8817-6a6b87fad196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Flow 'volume_create_manager' (fea6e9af-2f5f-4b16-a42c-820929fad960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:08 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-26e58a08-b4d5-4784-bb8b-b66fbb5dced3 tempest-VolumesTestJSON-2051305162 None] Created volume successfully.
Sep 23 15:21:08 devstack quobyte-client[84024]: System call of process 94875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:08 devstack quobyte-client[84024]: System call of process 94875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:08 devstack quobyte-client[84024]: System call of process 94875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae" returned: 0 in 0.725s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-db70d855-b898-45f6-b6bf-7774d15621ae" returned: 0 in 0.255s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Lock "cinder-quobyte-db70d855-b898-45f6-b6bf-7774d15621ae" released by "delete_volume" :: held 1.456s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.558s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Created reservations ['95ec17ec-e1ae-447e-9063-556d359d594d', '07f8a5f6-0bf5-4141-97da-60755c3f1840', 'b298cf25-701f-4aaf-a325-551afc16e1fd', '8d948623-89d9-4f20-89d3-37056bfd91f6'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.165s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Deleted volume successfully.
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7a201d22-ab44-4701-b5a3-1c437aa7fe8f tempest-VolumeQuotasAdminTestJSON-1096382857 None] Lock "cinder-db70d855-b898-45f6-b6bf-7774d15621ae-delete_volume" released by "delete_volume" :: held 4.389s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Flow 'volume_create_manager' (37af77ed-5845-4710-9116-672991c8eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48510dd5-2b9f-44c0-a8de-3cd2f4065af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48510dd5-2b9f-44c0-a8de-3cd2f4065af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-823906568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb67d8a3-c551-40b7-899b-6c691d04b2df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7310c5daa3d54a67a95c0b0140cce46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:11Z,use_quota=True,user_id='32e024be4e144b13a6cb82617ae093bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b76bbee-5e20-4983-b0a5-9cc8cb2af7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b76bbee-5e20-4983-b0a5-9cc8cb2af7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14942c6a-2137-4f02-bc73-49df47c721c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14942c6a-2137-4f02-bc73-49df47c721c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb67d8a3-c551-40b7-899b-6c691d04b2df', 'volume_name': 'volume-fb67d8a3-c551-40b7-899b-6c691d04b2df', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec55dcb-3650-4ce1-a794-8b13fb03bf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec55dcb-3650-4ce1-a794-8b13fb03bf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abe6cff-0483-48e1-b4de-7549000a47fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Volume fb67d8a3-c551-40b7-899b-6c691d04b2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb67d8a3-c551-40b7-899b-6c691d04b2df', 'volume_size': 1}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-823906568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb67d8a3-c551-40b7-899b-6c691d04b2df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7310c5daa3d54a67a95c0b0140cce46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:11Z,use_quota=True,user_id='32e024be4e144b13a6cb82617ae093bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Creating volume fb67d8a3-c551-40b7-899b-6c691d04b2df {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:11 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:11 devstack quobyte-client[84024]: System call of process 94882 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:11 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=62, name=volume-fb67d8a3-c551-40b7-899b-6c691d04b2df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df 1073741824" returned: 0 in 0.550s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df" returned: 0 in 0.265s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] <== create_volume: return (980ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abe6cff-0483-48e1-b4de-7549000a47fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb67d8a3-c551-40b7-899b-6c691d04b2df', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f90d13f-1e3b-43cd-bf7b-9c5a4f1d4bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Volume volume-fb67d8a3-c551-40b7-899b-6c691d04b2df (fb67d8a3-c551-40b7-899b-6c691d04b2df): created successfully
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f90d13f-1e3b-43cd-bf7b-9c5a4f1d4bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Flow 'volume_create_manager' (37af77ed-5845-4710-9116-672991c8eda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Flow 'volume_create_manager' (d352beda-34db-4c2c-88c5-5c41fb9f5abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889d7d76-14a7-4e7a-bdf1-c6bfd773adb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-eb0c0e96-5655-4632-b21a-969f248b2f8f tempest-VolumesTestJSON-2051305162 None] Created volume successfully.
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889d7d76-14a7-4e7a-bdf1-c6bfd773adb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-539594321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236fa2e6-218b-4583-8a95-ab49980f41aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e8e4c3790473c9df8fa07bcd60573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:12Z,use_quota=True,user_id='328192df6b434efd90d4d6a3c03f60f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93592595-0280-4cd1-a45a-549c8b4f8540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93592595-0280-4cd1-a45a-549c8b4f8540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01856ec-a25d-47bb-9497-b305637d6db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01856ec-a25d-47bb-9497-b305637d6db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '236fa2e6-218b-4583-8a95-ab49980f41aa', 'volume_name': 'volume-236fa2e6-218b-4583-8a95-ab49980f41aa', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40064540-028c-4beb-8e6d-5f64451b16dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40064540-028c-4beb-8e6d-5f64451b16dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6654d47-ef0c-4753-97a1-7623ec083e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume 236fa2e6-218b-4583-8a95-ab49980f41aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-236fa2e6-218b-4583-8a95-ab49980f41aa', 'volume_size': 1}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-539594321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236fa2e6-218b-4583-8a95-ab49980f41aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e8e4c3790473c9df8fa07bcd60573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:12Z,use_quota=True,user_id='328192df6b434efd90d4d6a3c03f60f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Creating volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:13 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:13 devstack quobyte-client[84024]: System call of process 94886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:13 devstack quobyte-client[84024]: System call of process 94886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=63, name=volume-236fa2e6-218b-4583-8a95-ab49980f41aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa 1073741824" returned: 0 in 0.477s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa" returned: 0 in 0.204s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6654d47-ef0c-4753-97a1-7623ec083e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236fa2e6-218b-4583-8a95-ab49980f41aa', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510abcb3-0e49-452c-a343-4c875ba7ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume volume-236fa2e6-218b-4583-8a95-ab49980f41aa (236fa2e6-218b-4583-8a95-ab49980f41aa): created successfully
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510abcb3-0e49-452c-a343-4c875ba7ed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Flow 'volume_create_manager' (d352beda-34db-4c2c-88c5-5c41fb9f5abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-73798491-5533-4576-b629-f47cb324609e tempest-VolumesSnapshotListTestJSON-1263469070 None] Created volume successfully.
Sep 23 15:21:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Flow 'volume_create_manager' (0055bede-04a8-45f8-83d1-c111954d5d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad710786-4036-4ea4-88fe-06c8c12229bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad710786-4036-4ea4-88fe-06c8c12229bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-577580340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b882fcf7-fbc3-4f0e-b834-1bc076fb4df2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7310c5daa3d54a67a95c0b0140cce46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:14Z,use_quota=True,user_id='32e024be4e144b13a6cb82617ae093bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5feda2-73c8-4faf-8d8c-2febb8fd47a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef5feda2-73c8-4faf-8d8c-2febb8fd47a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b64f20a-ca86-4133-990d-aea54d7dd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b64f20a-ca86-4133-990d-aea54d7dd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b882fcf7-fbc3-4f0e-b834-1bc076fb4df2', 'volume_name': 'volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8659b563-cfb9-407f-a3fb-70bd8b0600cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8659b563-cfb9-407f-a3fb-70bd8b0600cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a897cf99-5a0a-4398-a912-1fd0a25363bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Volume b882fcf7-fbc3-4f0e-b834-1bc076fb4df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2', 'volume_size': 1}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-577580340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b882fcf7-fbc3-4f0e-b834-1bc076fb4df2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7310c5daa3d54a67a95c0b0140cce46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:14Z,use_quota=True,user_id='32e024be4e144b13a6cb82617ae093bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Creating volume b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:14 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:14 devstack quobyte-client[84024]: System call of process 94890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:14 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=64, name=volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 1073741824" returned: 0 in 0.547s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2" returned: 0 in 0.482s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] <== create_volume: return (1111ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a897cf99-5a0a-4398-a912-1fd0a25363bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131deb6f-2834-43f2-98da-dd01f4b188ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Creating offline snapshot 4915ee28-64ec-494f-82bf-29b4f411ed28 of volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:21:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Volume volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 (b882fcf7-fbc3-4f0e-b834-1bc076fb4df2): created successfully
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131deb6f-2834-43f2-98da-dd01f4b188ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Flow 'volume_create_manager' (0055bede-04a8-45f8-83d1-c111954d5d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:16 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e64f703-e3c5-4d41-a2e0-456fac788e93]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fdf33050-b68b-492b-859a-104e728ed6b9 tempest-VolumesTestJSON-2051305162 None] Created volume successfully.
Sep 23 15:21:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa" returned: 0 in 1.208s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:17 devstack quobyte-client[84024]: System call of process 94898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:17 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=65, name=volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 1G" returned: 0 in 0.762s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img rebase -u -b volume-236fa2e6-218b-4583-8a95-ab49980f41aa -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:18 devstack quobyte-client[84024]: System call of process 94901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:18 devstack quobyte-client[84024]: System call of process 94901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "cinder-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img rebase -u -b volume-236fa2e6-218b-4583-8a95-ab49980f41aa -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.680s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:21:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2-delete_volume" acquired by "delete_volume" :: waited 0.474s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.462s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:21:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.641s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "cinder-quobyte-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.info" returned: 0 in 0.508s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.info" returned: 0 in 0.236s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.951s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-quobyte-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2" acquired by "delete_volume" :: waited 0.517s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9563f5da-1844-47e2-a4e4-ba9987c6dde9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5a918185-c556-47c3-aa6a-66e601b78a2e tempest-VolumesSnapshotListTestJSON-1263469070 None] Create snapshot completed successfully
Sep 23 15:21:21 devstack quobyte-client[84024]: System call of process 94940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2" returned: 0 in 0.699s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2" returned: 0 in 0.141s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-quobyte-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2" released by "delete_volume" :: held 1.449s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:22 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Creating offline snapshot 3f5b4350-9c88-4e61-80d2-1daf26c635a1 of volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d210b-2fea-48a3-a4cf-c7b2f08f6175]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Created reservations ['b885074b-d4a3-4f1c-b067-f818245c4ff5', '6335cf98-3e21-4ff3-9848-cf2a400ea4c7', '44d45cc8-4e91-47e5-b36d-4155e0330d8f', '387d124c-d346-404e-b774-dc42e435d44e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.958s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.354s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:23 devstack quobyte-client[84024]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:23 devstack quobyte-client[84024]: System call of process 94948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:23 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:24 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Deleted volume successfully.
Sep 23 15:21:24 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=67, name=volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a30187e-c554-419a-b6b2-9dcdd31be7e1 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-b882fcf7-fbc3-4f0e-b834-1bc076fb4df2-delete_volume" released by "delete_volume" :: held 5.237s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 1G" returned: 0 in 0.622s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img rebase -u -b volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:24 devstack quobyte-client[84024]: System call of process 94951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:24 devstack quobyte-client[84024]: System call of process 94951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:24 devstack quobyte-client[84024]: System call of process 94951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:24 devstack quobyte-client[84024]: System call of process 94951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img rebase -u -b volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.220s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Acquiring lock "cinder-fb67d8a3-c551-40b7-899b-6c691d04b2df-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.429s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Lock "cinder-fb67d8a3-c551-40b7-899b-6c691d04b2df-delete_volume" acquired by "delete_volume" :: waited 0.293s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.401s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Acquiring lock "cinder-quobyte-fb67d8a3-c551-40b7-899b-6c691d04b2df" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:25 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-bc2b110f-ef83-4343-9317-6ab508d92d2a tempest-VolumesSnapshotListTestJSON-1263469070 None] Create snapshot completed successfully
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Lock "cinder-quobyte-fb67d8a3-c551-40b7-899b-6c691d04b2df" acquired by "delete_volume" :: waited 0.046s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a32a20a-5792-4f4e-8529-f3e2f84f3bbc]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:26 devstack quobyte-client[84024]: System call of process 94956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df" returned: 0 in 0.511s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-fb67d8a3-c551-40b7-899b-6c691d04b2df" returned: 0 in 0.134s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Lock "cinder-quobyte-fb67d8a3-c551-40b7-899b-6c691d04b2df" released by "delete_volume" :: held 0.906s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Creating offline snapshot 60ea9d62-cbfc-4761-ad93-1ed6933c8491 of volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b85327-6256-45e3-adf5-a4426e4dd316]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Created reservations ['0908e9ae-c339-4946-8d70-eeed71e25cb9', '7fa89545-e155-4ae1-beea-0c8e17862e5a', 'caf45f50-b17e-4481-9289-c9cf92db2a49', 'ed0fb345-4f34-41db-9aff-69ce7a567f80'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Flow 'volume_create_manager' (9132569d-9605-4efb-96d5-dcd32f343425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50189ad1-4f83-46e2-877b-8849cb09de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:27 devstack quobyte-client[84024]: System call of process 94967 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50189ad1-4f83-46e2-877b-8849cb09de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-499170298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a7f375-fd10-4dcf-8724-5a8d25d3c7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3ab49482874dfe86a5d98276ed69ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:27Z,use_quota=True,user_id='d6cc2059c3de477c92e511dc66039b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(058dc6b4-1230-4067-81ce-047fa4819933),volume_type_id=058dc6b4-1230-4067-81ce-047fa4819933)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32633d46-6092-44ee-a47f-0c27de25be3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32633d46-6092-44ee-a47f-0c27de25be3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e27026-9c39-4e0e-9061-69f4f1d0c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e27026-9c39-4e0e-9061-69f4f1d0c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a7f375-fd10-4dcf-8724-5a8d25d3c7bc', 'volume_name': 'volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3f5ee0-dce4-48f8-85a8-8e9d2b7cbc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3f5ee0-dce4-48f8-85a8-8e9d2b7cbc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb9967a-5a12-47d6-85bc-6c9ef6dc1f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:28 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Volume 19a7f375-fd10-4dcf-8724-5a8d25d3c7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc', 'volume_size': 1}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.780s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:28 devstack quobyte-client[84024]: System call of process 94970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:28 devstack quobyte-client[84024]: System call of process 94970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:28 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=68, name=volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "cinder-0e2739de-828e-41c5-8339-1260bafc0e23-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-0e2739de-828e-41c5-8339-1260bafc0e23-delete_volume" acquired by "delete_volume" :: waited 0.371s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 1G" returned: 0 in 1.013s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img rebase -u -b volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:29 devstack quobyte-client[84024]: System call of process 94974 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:29 devstack quobyte-client[84024]: System call of process 94974 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.835s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:29 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Deleted volume successfully.
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img rebase -u -b volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491" returned: 0 in 0.586s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:21:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "cinder-quobyte-0e2739de-828e-41c5-8339-1260bafc0e23" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4fea2287-8f6a-4207-82d6-422de478f2ce tempest-VolumesTestJSON-2051305162 None] Lock "cinder-fb67d8a3-c551-40b7-899b-6c691d04b2df-delete_volume" released by "delete_volume" :: held 5.091s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491" returned: 0 in 0.593s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491" returned: 0 in 0.154s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.434s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-quobyte-0e2739de-828e-41c5-8339-1260bafc0e23" acquired by "delete_volume" :: waited 0.410s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.651s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-499170298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a7f375-fd10-4dcf-8724-5a8d25d3c7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3ab49482874dfe86a5d98276ed69ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:27Z,use_quota=True,user_id='d6cc2059c3de477c92e511dc66039b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(058dc6b4-1230-4067-81ce-047fa4819933),volume_type_id=058dc6b4-1230-4067-81ce-047fa4819933)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Creating volume 19a7f375-fd10-4dcf-8724-5a8d25d3c7bc {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:30 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:30 devstack quobyte-client[84024]: System call of process 94980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:30 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=69, name=volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d1671-306a-4e29-8599-157eb639b284]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc 1073741824" returned: 0 in 0.769s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:31 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4f97803c-823e-427a-a3c4-9cb26e7b4d37 tempest-VolumesSnapshotListTestJSON-1263469070 None] Create snapshot completed successfully
Sep 23 15:21:31 devstack quobyte-client[84024]: System call of process 94983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=97,cinder:SELECT=85,cinder:INSERT=37,cinder:DELETE=12 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc" returned: 0 in 0.638s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] <== create_volume: return (1463ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23" returned: 0 in 1.143s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb9967a-5a12-47d6-85bc-6c9ef6dc1f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c329e23-9fc6-442e-913f-8a4c6ed2abd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0e2739de-828e-41c5-8339-1260bafc0e23" returned: 0 in 0.606s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:32 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Volume volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc (19a7f375-fd10-4dcf-8724-5a8d25d3c7bc): created successfully
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c329e23-9fc6-442e-913f-8a4c6ed2abd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Flow 'volume_create_manager' (9132569d-9605-4efb-96d5-dcd32f343425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-quobyte-0e2739de-828e-41c5-8339-1260bafc0e23" released by "delete_volume" :: held 2.392s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:33 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-cdd98e1b-db9b-44a6-b9a1-6b56e37cffc8 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Created volume successfully.
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Created reservations ['111c27a9-ee13-455f-8ee8-eba55698fb65', '828dc984-0985-45db-823c-1b7f76b7363c', '943178a1-772d-4c34-b858-d873f2a3a694', '2c6779ee-87b0-4db2-8a68-865f11aaa3e8'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.133s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:33 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Deleted volume successfully.
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-60ea9d62-cbfc-4761-ad93-1ed6933c8491-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1da8f50b-0033-4b74-9c7b-b82eb956a3d5 tempest-VolumesTestJSON-2051305162 None] Lock "cinder-0e2739de-828e-41c5-8339-1260bafc0e23-delete_volume" released by "delete_volume" :: held 5.082s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-60ea9d62-cbfc-4761-ad93-1ed6933c8491-delete_snapshot" acquired by "delete_snapshot" :: waited 0.119s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:33 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-60ea9d62-cbfc-4761-ad93-1ed6933c8491" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-60ea9d62-cbfc-4761-ad93-1ed6933c8491" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Deleting offline snapshot 60ea9d62-cbfc-4761-ad93-1ed6933c8491 of volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] snapshot_file for this snap is: volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b2e86e-cdec-4f33-b300-118dd13023ab]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:34 devstack quobyte-client[84024]: System call of process 94989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491" returned: 0 in 0.786s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=129,cinder:DELETE=12,cinder:SELECT=76,cinder:INSERT=17 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:21:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[239feefd-5a2d-480b-a90c-21aad0d7614a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:35 devstack quobyte-client[84024]: System call of process 94992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:35 devstack quobyte-client[84024]: System call of process 94992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.863s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.422s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:36 devstack quobyte-client[84024]: System call of process 94997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:36 devstack quobyte-client[84024]: System call of process 94997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:36 devstack quobyte-client[84024]: System call of process 94997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7164ec50-bfeb-4d81-a315-8a9b2b1c3184 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Retype volume completed successfully.
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Acquiring lock "cinder-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "cinder-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491" returned: 0 in 0.748s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Acquiring lock "cinder-quobyte-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.60ea9d62-cbfc-4761-ad93-1ed6933c8491" returned: 0 in 0.492s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-60ea9d62-cbfc-4761-ad93-1ed6933c8491" released by "_delete_snapshot" :: held 3.292s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "cinder-quobyte-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc" acquired by "delete_volume" :: waited 0.101s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" released by "delete_snapshot" :: held 3.379s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[642e3a9f-f47f-4e3d-a41f-eab0573702ad]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:37 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Created reservations ['8d5585b4-c303-480c-bbbe-0e6eb7f94101', '7c5efb24-d6b2-486b-88df-25442444a87a', 'd42084b1-ec61-4fd2-93bc-7dc99ae49b3b', '3c1b64b5-d9e3-4f3c-abcf-82df6afaf358'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:38 devstack quobyte-client[84024]: System call of process 95001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc" returned: 0 in 0.696s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:38 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Delete snapshot completed successfully.
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc" returned: 0 in 0.250s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-db83d843-2b09-4e11-8640-a09679d28e62 tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-60ea9d62-cbfc-4761-ad93-1ed6933c8491-delete_snapshot" released by "delete_snapshot" :: held 4.442s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "cinder-quobyte-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc" released by "delete_volume" :: held 1.136s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-3f5b4350-9c88-4e61-80d2-1daf26c635a1-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-3f5b4350-9c88-4e61-80d2-1daf26c635a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:38 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:38 devstack cinder-volume[84009]: WARNING cinder.quota [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:21:38 devstack cinder-volume[84009]: WARNING cinder.quota [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" acquired by "delete_snapshot" :: waited 0.075s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-3f5b4350-9c88-4e61-80d2-1daf26c635a1" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Created reservations ['2bf2f282-3011-4c70-a653-4321ff1c287d', '7194437b-fded-463c-87e8-53e8b7c6f494', 'e80d9aa0-8e1f-4110-b4d3-80e1c83b651b', '70e727dc-993f-442f-972d-0317b1379c33'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-3f5b4350-9c88-4e61-80d2-1daf26c635a1" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Deleting offline snapshot 3f5b4350-9c88-4e61-80d2-1daf26c635a1 of volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] snapshot_file for this snap is: volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[339b4a66-dd26-4eac-9673-f1bc2dbc87d8]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:39 devstack quobyte-client[84024]: System call of process 95005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.221s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.667s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:39 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Deleted volume successfully.
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e143f8be-5a87-4c3f-b1ef-e811995fd993]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f6dbb077-522f-4b60-a81d-5678a3994716 tempest-BackendsCapabilitiesAdminTestsJSON-397518209 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84009) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3dcec6f4-7680-4181-8b1a-cbe4300df968 tempest-VolumeRetypeWithoutMigrationTest-553550350 None] Lock "cinder-19a7f375-fd10-4dcf-8724-5a8d25d3c7bc-delete_volume" released by "delete_volume" :: held 3.675s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:40 devstack quobyte-client[84024]: System call of process 95009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:40 devstack quobyte-client[84024]: System call of process 95009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:40 devstack quobyte-client[84024]: System call of process 95009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.535s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:40 devstack quobyte-client[84024]: System call of process 95012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:40 devstack quobyte-client[84024]: System call of process 95012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:40 devstack quobyte-client[84024]: System call of process 95012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6a6d553a-ff67-468c-8974-b46c5269fc31 tempest-BackendsCapabilitiesAdminTestsJSON-397518209 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84009) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.371s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.3f5b4350-9c88-4e61-80d2-1daf26c635a1" returned: 0 in 0.139s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-3f5b4350-9c88-4e61-80d2-1daf26c635a1" released by "_delete_snapshot" :: held 2.203s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" released by "delete_snapshot" :: held 2.298s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Created reservations ['1ded10b6-f969-4e37-8279-041117b2118b', '297d6f8f-af9f-43e9-8384-b9c00a1442ac', 'ba3b286a-1043-478e-a414-6144d8bf9556', 'af3ab676-c319-4311-9f31-9a176095c56b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Delete snapshot completed successfully.
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae13d6f6-19fe-47f1-9dec-59838bcf637e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-3f5b4350-9c88-4e61-80d2-1daf26c635a1-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-4915ee28-64ec-494f-82bf-29b4f411ed28-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-4915ee28-64ec-494f-82bf-29b4f411ed28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:41 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-4915ee28-64ec-494f-82bf-29b4f411ed28" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-4915ee28-64ec-494f-82bf-29b4f411ed28" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Deleting offline snapshot 4915ee28-64ec-494f-82bf-29b4f411ed28 of volume 236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] snapshot_file for this snap is: volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb352161-da2b-499e-91ae-a7e319b3bb3d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:42 devstack quobyte-client[84024]: System call of process 95016 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.564s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-236fa2e6-218b-4583-8a95-ab49980f41aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95d0d16-1452-40d5-ba1a-618b91a912ea]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:43 devstack quobyte-client[84024]: System call of process 95019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa" returned: 0 in 0.552s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:43 devstack quobyte-client[84024]: System call of process 95022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:43 devstack quobyte-client[84024]: System call of process 95022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.317s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa.4915ee28-64ec-494f-82bf-29b4f411ed28" returned: 0 in 0.132s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-4915ee28-64ec-494f-82bf-29b4f411ed28" released by "_delete_snapshot" :: held 1.969s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" released by "delete_snapshot" :: held 1.995s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:44 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Created reservations ['12743a57-bc13-437f-8c6a-bf1343fe7e33', '8f8fd886-a196-4207-a475-a2568f3bb7e0', 'f8d2c995-fd22-4d91-baae-05bb5a336789', 'd1acc992-4ab2-430b-9114-c03d110d706f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Delete snapshot completed successfully.
Sep 23 15:21:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3cfde31-60c2-4aac-bee7-c49db6e02b5e tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-4915ee28-64ec-494f-82bf-29b4f411ed28-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-236fa2e6-218b-4583-8a95-ab49980f41aa-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-236fa2e6-218b-4583-8a95-ab49980f41aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b6d811-0f3b-4e98-94d2-736ed65ac673]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:46 devstack quobyte-client[84024]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa" returned: 0 in 0.556s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-236fa2e6-218b-4583-8a95-ab49980f41aa" returned: 0 in 0.159s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-quobyte-236fa2e6-218b-4583-8a95-ab49980f41aa" released by "delete_volume" :: held 0.993s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Created reservations ['719d4a66-3497-4eea-b963-206232de8dc9', '53b218ae-b707-4a01-9ce3-a5c701881102', '2c61bb9e-c2cf-43b9-9f7f-843b73ecee12', 'b0f100cc-36c0-4f05-93f9-4748db7daa2c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.189s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Deleted volume successfully.
Sep 23 15:21:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07965db3-a369-4485-af19-d9858c8a76aa tempest-VolumesSnapshotListTestJSON-1263469070 None] Lock "cinder-236fa2e6-218b-4583-8a95-ab49980f41aa-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Flow 'volume_create_manager' (a12f0ee5-6b38-4468-9456-d81505ac2ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3a2f44-0198-4bcd-84c8-a80d55cc5424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3a2f44-0198-4bcd-84c8-a80d55cc5424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1378391709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d01735fb070457186db3286820975c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:48Z,use_quota=True,user_id='827bf13657c847fab6ca88ced93a2262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64717f68-d915-4d5b-92da-b917f5c4b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64717f68-d915-4d5b-92da-b917f5c4b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc03d772-b87c-46ee-8dd0-c87278d38f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc03d772-b87c-46ee-8dd0-c87278d38f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2', 'volume_name': 'volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb21b49-c891-4dde-92b1-05e72ecbb4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb21b49-c891-4dde-92b1-05e72ecbb4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bafd9f-9237-4a6b-8a06-abf2fa134dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Volume d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2', 'volume_size': 1}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1378391709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d01735fb070457186db3286820975c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:48Z,use_quota=True,user_id='827bf13657c847fab6ca88ced93a2262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Creating volume d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:48 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:48 devstack quobyte-client[84024]: System call of process 95034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:48 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=70, name=volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fb24f58c-419f-4e77-a984-270a575675b1 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fb24f58c-419f-4e77-a984-270a575675b1 tempest-GroupSnapshotsTest-297693473 None] Group tempest-GroupSnapshotsTest-Group-831593183: creating
Sep 23 15:21:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 1073741824" returned: 0 in 0.551s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fb24f58c-419f-4e77-a984-270a575675b1 tempest-GroupSnapshotsTest-297693473 None] Group tempest-GroupSnapshotsTest-Group-831593183: created successfully
Sep 23 15:21:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2" returned: 0 in 0.512s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] <== create_volume: return (1086ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fb24f58c-419f-4e77-a984-270a575675b1 tempest-GroupSnapshotsTest-297693473 None] Create group completed successfully.
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bafd9f-9237-4a6b-8a06-abf2fa134dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caceb340-a456-421a-9188-6ccac419c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Volume volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 (d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2): created successfully
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caceb340-a456-421a-9188-6ccac419c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Flow 'volume_create_manager' (a12f0ee5-6b38-4468-9456-d81505ac2ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e7d0a9c8-b6cb-4dee-aff4-5a91b037c789 tempest-VolumesServicesTestJSON-474177578 None] Created volume successfully.
Sep 23 15:21:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (ed4b931e-a008-4733-b11a-16089104f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b242fc00-8a16-4a58-b136-8b1f58c3d663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Acquiring lock "cinder-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b242fc00-8a16-4a58-b136-8b1f58c3d663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608402973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dc74fb2e-709d-4663-ad59-23d959fd7915,host='devstack@QuobyteHD#QuobyteHD',id=6a90696d-b312-4265-b87c-072c2add44f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:51Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0886ee10-30bb-412d-a96e-2aedf8f8b664),volume_type_id=0886ee10-30bb-412d-a96e-2aedf8f8b664)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aef18d4-509b-4a11-acb6-4b2d2b25ad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aef18d4-509b-4a11-acb6-4b2d2b25ad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39df5f41-0aeb-403c-aa8d-656376ea45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39df5f41-0aeb-403c-aa8d-656376ea45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a90696d-b312-4265-b87c-072c2add44f6', 'volume_name': 'volume-6a90696d-b312-4265-b87c-072c2add44f6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3cda38-4431-4bfb-b43c-4ea0498a2dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3cda38-4431-4bfb-b43c-4ea0498a2dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65d9d50-2ca0-4dc5-a0a3-d0f52eb119dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Volume 6a90696d-b312-4265-b87c-072c2add44f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a90696d-b312-4265-b87c-072c2add44f6', 'volume_size': 1}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dc74fb2e-709d-4663-ad59-23d959fd7915,created_at=2025-09-23T13:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608402973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dc74fb2e-709d-4663-ad59-23d959fd7915,host='devstack@QuobyteHD#QuobyteHD',id=6a90696d-b312-4265-b87c-072c2add44f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:21:51Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0886ee10-30bb-412d-a96e-2aedf8f8b664),volume_type_id=0886ee10-30bb-412d-a96e-2aedf8f8b664)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Creating volume 6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:21:50 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:21:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:51 devstack quobyte-client[84024]: System call of process 95038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:51 devstack quobyte-client[84024]: System call of process 95038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:51 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=71, name=volume-6a90696d-b312-4265-b87c-072c2add44f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Lock "cinder-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2-delete_volume" acquired by "delete_volume" :: waited 0.376s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 1073741824" returned: 0 in 0.561s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:51 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Acquiring lock "cinder-quobyte-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 0.517s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] <== create_volume: return (1108ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65d9d50-2ca0-4dc5-a0a3-d0f52eb119dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a90696d-b312-4265-b87c-072c2add44f6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6978890-a21e-46e0-8950-897ee1d146e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Lock "cinder-quobyte-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2" acquired by "delete_volume" :: waited 0.166s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77f312a-7caa-4cb6-8113-c76e85b972c2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:52 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Volume volume-6a90696d-b312-4265-b87c-072c2add44f6 (6a90696d-b312-4265-b87c-072c2add44f6): created successfully
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6978890-a21e-46e0-8950-897ee1d146e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (ed4b931e-a008-4733-b11a-16089104f38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:21:52 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3d7e4ca1-b378-493d-9b51-e13c584684c3 tempest-GroupSnapshotsTest-297693473 None] Created volume successfully.
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2" returned: 0 in 0.668s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2" returned: 0 in 0.149s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Lock "cinder-quobyte-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2" released by "delete_volume" :: held 1.052s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] GroupSnapshot 35356c4c-e631-46cc-a626-a510bf07b520: creating.
Sep 23 15:21:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Group snapshot 35356c4c-e631-46cc-a626-a510bf07b520: creating. {{(pid=84009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Creating offline snapshot 63077ec8-9c68-4c50-b78a-67ed214a9934 of volume 6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Created reservations ['1cd3b4d7-fb5d-4689-9d65-5c64f332745f', 'e02f2e8d-720a-49e3-895a-1a9f76eae750', '3f336fea-985b-416d-bf4c-680ee20f0f0d', '20c54c1c-bfa7-481e-96ad-947d039a184f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08a028-2289-48fe-b9a9-7b138b6619f1]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:21:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.147s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:21:54 devstack quobyte-client[84024]: System call of process 95046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:54 devstack quobyte-client[84024]: System call of process 95046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:54 devstack quobyte-client[84024]: System call of process 95046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:54 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Deleted volume successfully.
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 1.136s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:55 devstack quobyte-client[84024]: System call of process 95050 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:55 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=72, name=volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-1f65fd03-282f-4b75-acb7-3c081c86f754 tempest-VolumesServicesTestJSON-474177578 None] Lock "cinder-d90e4b13-c9b1-4ba9-bd8e-d1bb85d2edd2-delete_volume" released by "delete_volume" :: held 3.937s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 1G" returned: 0 in 0.355s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6a90696d-b312-4265-b87c-072c2add44f6 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:55 devstack quobyte-client[84024]: System call of process 95053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:55 devstack quobyte-client[84024]: System call of process 95053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:55 devstack quobyte-client[84024]: System call of process 95053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:55 devstack quobyte-client[84024]: System call of process 95053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img rebase -u -b volume-6a90696d-b312-4265-b87c-072c2add44f6 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.251s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.188s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:21:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.186s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.info" returned: 0 in 0.151s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.info" returned: 0 in 0.140s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:21:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:21:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-68d86cdc-ae81-45b5-abfd-955c89de71eb tempest-GroupSnapshotsTest-297693473 None] group_snapshot 35356c4c-e631-46cc-a626-a510bf07b520: created successfully
Sep 23 15:21:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:21:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:21:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:21:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-63077ec8-9c68-4c50-b78a-67ed214a9934-2ed3a319-67fa-4351-b385-629f06badacc" by "_create_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-63077ec8-9c68-4c50-b78a-67ed214a9934-2ed3a319-67fa-4351-b385-629f06badacc" acquired by "_create_volume_from_snapshot" :: waited 0.071s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Creating volume 2ed3a319-67fa-4351-b385-629f06badacc from snapshot 63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-2ed3a319-67fa-4351-b385-629f06badacc" by "_copy_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-2ed3a319-67fa-4351-b385-629f06badacc" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] snapshot: 63077ec8-9c68-4c50-b78a-67ed214a9934, volume: 2ed3a319-67fa-4351-b385-629f06badacc,  {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895c38b-7b65-4ca4-8898-d9e4c7931328]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:00 devstack quobyte-client[84024]: System call of process 95061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:00 devstack quobyte-client[84024]: System call of process 95061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:00 devstack quobyte-client[84024]: System call of process 95061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:00 devstack quobyte-client[84024]: System call of process 95061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.678s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a90696d-b312-4265-b87c-072c2add44f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 23 15:22:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Creating direct copy from snapshot {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 23 15:22:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00dd5dd-b476-4a71-abb2-6809e0048112]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 1.005s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:02 devstack cinder-volume[84009]: DEBUG cinder.utils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc not found in is_blk_device check {{(pid=84009) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 23 15:22:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:02 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=74, name=volume-2ed3a319-67fa-4351-b385-629f06badacc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:07 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:22:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Flow 'volume_create_manager' (5e0e8f26-4009-4dee-9a3b-229e68bd0a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022a0f35-37fd-4cd6-aaf5-859bff8fc9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022a0f35-37fd-4cd6-aaf5-859bff8fc9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-279680636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fa6990-f262-4f5f-9065-fc226e82fe63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03283a9ad006482c91bc2e43617c9734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:07Z,use_quota=True,user_id='f6b79966c37f45fb95a70402f6c8acb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d2e98b-d90f-4716-b62f-b1cecdec5b44),volume_type_id=15d2e98b-d90f-4716-b62f-b1cecdec5b44)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe4b29b-1d0d-4c34-b927-f3d9a976312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe4b29b-1d0d-4c34-b927-f3d9a976312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f278824-7bc4-45c8-b92e-10e5cc63a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f278824-7bc4-45c8-b92e-10e5cc63a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fa6990-f262-4f5f-9065-fc226e82fe63', 'volume_name': 'volume-c2fa6990-f262-4f5f-9065-fc226e82fe63', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ceb05c-19c9-4164-8056-71f23bac0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ceb05c-19c9-4164-8056-71f23bac0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288135e1-ff59-4eed-a319-390b37e413e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Volume c2fa6990-f262-4f5f-9065-fc226e82fe63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fa6990-f262-4f5f-9065-fc226e82fe63', 'volume_size': 1}
Sep 23 15:22:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.672s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:22:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc" returned: 0 in 8.472s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:10 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63ead4-a6c4-4f25-8131-663ba12e67b4]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:11 devstack quobyte-client[84024]: System call of process 95095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 0.823s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Image conversion details: src /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:22:11 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Converted 1024.00 MB image at 120.64 MB/s
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc" returned: 0 in 0.149s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-2ed3a319-67fa-4351-b385-629f06badacc" released by "_copy_volume_from_snapshot" :: held 11.880s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-63077ec8-9c68-4c50-b78a-67ed214a9934-2ed3a319-67fa-4351-b385-629f06badacc" released by "_create_volume_from_snapshot" :: held 11.946s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.040s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-279680636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fa6990-f262-4f5f-9065-fc226e82fe63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03283a9ad006482c91bc2e43617c9734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:07Z,use_quota=True,user_id='f6b79966c37f45fb95a70402f6c8acb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d2e98b-d90f-4716-b62f-b1cecdec5b44),volume_type_id=15d2e98b-d90f-4716-b62f-b1cecdec5b44)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Creating volume c2fa6990-f262-4f5f-9065-fc226e82fe63 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:22:12 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:12 devstack quobyte-client[84024]: System call of process 95100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:12 devstack quobyte-client[84024]: System call of process 95100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:12 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=75, name=volume-c2fa6990-f262-4f5f-9065-fc226e82fe63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63 1073741824" returned: 0 in 0.748s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63" returned: 0 in 0.582s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] <== create_volume: return (1419ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288135e1-ff59-4eed-a319-390b37e413e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fa6990-f262-4f5f-9065-fc226e82fe63', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aab2e16-26a4-48c2-9cf1-3574ab11c6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Volume volume-c2fa6990-f262-4f5f-9065-fc226e82fe63 (c2fa6990-f262-4f5f-9065-fc226e82fe63): created successfully
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aab2e16-26a4-48c2-9cf1-3574ab11c6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Flow 'volume_create_manager' (5e0e8f26-4009-4dee-9a3b-229e68bd0a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-2ed3a319-67fa-4351-b385-629f06badacc" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6b997a79-8af0-4e38-9853-6b72d1b68663 tempest-VolumeTypesAccessTest-212750196 None] Created volume successfully.
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-2ed3a319-67fa-4351-b385-629f06badacc" acquired by "delete_volume" :: waited 0.065s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159a0f0-fc18-4abe-b4e0-f40bd6a82fe0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ac419001-dd11-4baa-a145-61f72174f761 tempest-GroupSnapshotsTest-297693473 None] Create group from source-snapshot-35356c4c-e631-46cc-a626-a510bf07b520 completed successfully.
Sep 23 15:22:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Acquiring lock "cinder-c2fa6990-f262-4f5f-9065-fc226e82fe63-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Lock "cinder-c2fa6990-f262-4f5f-9065-fc226e82fe63-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc" returned: 0 in 1.022s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2ed3a319-67fa-4351-b385-629f06badacc" returned: 0 in 0.397s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Acquiring lock "cinder-quobyte-c2fa6990-f262-4f5f-9065-fc226e82fe63" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-2ed3a319-67fa-4351-b385-629f06badacc" released by "delete_volume" :: held 1.663s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Lock "cinder-quobyte-c2fa6990-f262-4f5f-9065-fc226e82fe63" acquired by "delete_volume" :: waited 0.191s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1172d7-33e2-4146-bd09-52b3a1ad8a8c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:16 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['ad1881b6-757a-47e9-8a4d-d41b2139c8d6'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:16 devstack cinder-volume[84009]: WARNING cinder.quota [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2059734262 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2059734262, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:16 devstack cinder-volume[84009]: WARNING cinder.quota [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2059734262 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2059734262, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:16 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['7f2cff98-1660-44fe-8994-c001a19b5271', 'c641d444-80ab-4978-abb3-9dd842135c12', 'eb8f32bb-9bf4-4511-bfc2-6d7d95ddb0ef', 'eb7468a9-8f2b-438c-9458-3afc37f7626c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:16 devstack quobyte-client[84024]: System call of process 95108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63" returned: 0 in 0.841s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c2fa6990-f262-4f5f-9065-fc226e82fe63" returned: 0 in 0.341s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Lock "cinder-quobyte-c2fa6990-f262-4f5f-9065-fc226e82fe63" released by "delete_volume" :: held 1.380s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:17 devstack cinder-volume[84009]: WARNING cinder.quota [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2052135494 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2052135494, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:17 devstack cinder-volume[84009]: WARNING cinder.quota [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2052135494 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2052135494, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Created reservations ['e521b999-4fbf-4027-886f-4d193866f6a3', '2860c5c8-55c6-4cfa-93e6-dcf3c81c0a6e', '91e67770-ad98-4f1d-adf6-336b38254ae5', '8fdffa73-d8ab-441e-8bc3-4b7308c1938f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.336s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:22:17 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-12d1bd57-267f-4ef4-9caa-50209de9af61 tempest-GroupSnapshotsTest-297693473 None] Delete group completed successfully.
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.123s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:18 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:22:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Deleted volume successfully.
Sep 23 15:22:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] group_snapshot 35356c4c-e631-46cc-a626-a510bf07b520: deleting
Sep 23 15:22:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04afc1fe-b5c7-4cee-a64b-10ed7fccc488 tempest-VolumeTypesAccessTest-212750196 None] Lock "cinder-c2fa6990-f262-4f5f-9065-fc226e82fe63-delete_volume" released by "delete_volume" :: held 4.086s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] group_snapshot 35356c4c-e631-46cc-a626-a510bf07b520: deleting {{(pid=84009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-6a90696d-b312-4265-b87c-072c2add44f6" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-6a90696d-b312-4265-b87c-072c2add44f6" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-63077ec8-9c68-4c50-b78a-67ed214a9934" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-63077ec8-9c68-4c50-b78a-67ed214a9934" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Deleting offline snapshot 63077ec8-9c68-4c50-b78a-67ed214a9934 of volume 6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] snapshot_file for this snap is: volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb9899-1c22-4fd4-afc4-8a9328545aaa]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:19 devstack quobyte-client[84024]: System call of process 95115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.577s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a90696d-b312-4265-b87c-072c2add44f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea72bf-786c-48e2-85a3-d902beb6c794]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 0.603s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:20 devstack quobyte-client[84024]: System call of process 95121 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.467s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6.63077ec8-9c68-4c50-b78a-67ed214a9934" returned: 0 in 0.249s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-63077ec8-9c68-4c50-b78a-67ed214a9934" released by "_delete_snapshot" :: held 2.606s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-6a90696d-b312-4265-b87c-072c2add44f6" released by "delete_snapshot" :: held 2.661s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:22 devstack cinder-volume[84009]: WARNING cinder.quota [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2059734262 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2059734262, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:22 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['d2e76450-2f2e-42d0-8510-be451cc19f03', 'b47bea21-8ef6-4e88-b858-e543d6f9f642', '36b55d95-47b1-4df3-9f1e-f53419439ad9', '3ebeb1d4-903b-465d-8ac1-a22cb8f5d146'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9a6ffe53-9b42-4281-878d-ff4787c981a0 tempest-GroupSnapshotsTest-297693473 None] group_snapshot 35356c4c-e631-46cc-a626-a510bf07b520: deleted successfully
Sep 23 15:22:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-6a90696d-b312-4265-b87c-072c2add44f6" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-6a90696d-b312-4265-b87c-072c2add44f6" acquired by "delete_volume" :: waited 0.025s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85351818-5a76-42fa-9f74-7013c035e317]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 0.549s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6a90696d-b312-4265-b87c-072c2add44f6" returned: 0 in 0.153s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-6a90696d-b312-4265-b87c-072c2add44f6" released by "delete_volume" :: held 1.011s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['aba243d7-ae6a-475d-a92c-09a623dc9dee'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:25 devstack cinder-volume[84009]: WARNING cinder.db.sqlalchemy.api [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2059734262']
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['18e9ed8b-0ddf-438f-a226-265b330c50c8', 'f9121067-0729-4f22-81b8-19ce9cf6a3d6', '1cd44e64-bcac-440f-b179-d6f1a5817748', '5dc21ee4-dade-46a0-87a7-7ccec72d86f2'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.155s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:25 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:22:26 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f4339516-7468-40dd-afad-06ada5d86e74 tempest-GroupSnapshotsTest-297693473 None] Delete group completed successfully.
Sep 23 15:22:26 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e0a29078-c0c7-44b6-b1cc-5896e844727f tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:26 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e0a29078-c0c7-44b6-b1cc-5896e844727f tempest-GroupSnapshotsTest-297693473 None] Group tempest-GroupSnapshotsTest-Group-1120977999: creating
Sep 23 15:22:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e0a29078-c0c7-44b6-b1cc-5896e844727f tempest-GroupSnapshotsTest-297693473 None] Group tempest-GroupSnapshotsTest-Group-1120977999: created successfully
Sep 23 15:22:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e0a29078-c0c7-44b6-b1cc-5896e844727f tempest-GroupSnapshotsTest-297693473 None] Create group completed successfully.
Sep 23 15:22:28 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (c35a934f-c2ea-483d-808b-092ea50b533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13701855-63ec-40fa-9e23-2e6d6323d2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13701855-63ec-40fa-9e23-2e6d6323d2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660150265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36b8299d-b637-44db-962c-b0f843663ff5,host='devstack@QuobyteHD#QuobyteHD',id=da852c07-ecf8-4a1d-b5ec-71d9e91e9996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:28Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa2ef770-d40b-4f5c-8045-b286f04016f3),volume_type_id=fa2ef770-d40b-4f5c-8045-b286f04016f3)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3ea1f2-b96f-4d1b-9db1-67a880bf1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3ea1f2-b96f-4d1b-9db1-67a880bf1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291206fc-8f2d-4503-a7e4-284437cea271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291206fc-8f2d-4503-a7e4-284437cea271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da852c07-ecf8-4a1d-b5ec-71d9e91e9996', 'volume_name': 'volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9099c86a-06bb-486b-9bbf-010b5a756ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9099c86a-06bb-486b-9bbf-010b5a756ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1976265e-2fec-4f44-829d-bd5f0ca9e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:28 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Volume da852c07-ecf8-4a1d-b5ec-71d9e91e9996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996', 'volume_size': 1}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=36b8299d-b637-44db-962c-b0f843663ff5,created_at=2025-09-23T13:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660150265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36b8299d-b637-44db-962c-b0f843663ff5,host='devstack@QuobyteHD#QuobyteHD',id=da852c07-ecf8-4a1d-b5ec-71d9e91e9996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:28Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa2ef770-d40b-4f5c-8045-b286f04016f3),volume_type_id=fa2ef770-d40b-4f5c-8045-b286f04016f3)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Creating volume da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:22:28 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:22:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:29 devstack quobyte-client[84024]: System call of process 95169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:29 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=76, name=volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 1073741824" returned: 0 in 0.561s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" returned: 0 in 0.166s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:22:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1976265e-2fec-4f44-829d-bd5f0ca9e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da03841-defb-4951-899a-57619fd9e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:30 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Volume volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 (da852c07-ecf8-4a1d-b5ec-71d9e91e9996): created successfully
Sep 23 15:22:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da03841-defb-4951-899a-57619fd9e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (c35a934f-c2ea-483d-808b-092ea50b533f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f16ecf31-0f75-4ab2-ab0c-0da30e029266 tempest-GroupSnapshotsTest-297693473 None] Created volume successfully.
Sep 23 15:22:32 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (09e51d2e-5745-4605-8391-4c82fcffb847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273e2e5a-f4fb-4f8d-8f85-9c7285952bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273e2e5a-f4fb-4f8d-8f85-9c7285952bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1261954948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36b8299d-b637-44db-962c-b0f843663ff5,host='devstack@QuobyteHD#QuobyteHD',id=a3828f43-81ee-451e-ab85-2e64a194960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:32Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa2ef770-d40b-4f5c-8045-b286f04016f3),volume_type_id=fa2ef770-d40b-4f5c-8045-b286f04016f3)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316a89b7-2b0a-4748-8dab-7dcf1a0ce1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316a89b7-2b0a-4748-8dab-7dcf1a0ce1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1536b68b-8b30-4c6c-b2da-ced01d668a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1536b68b-8b30-4c6c-b2da-ced01d668a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3828f43-81ee-451e-ab85-2e64a194960b', 'volume_name': 'volume-a3828f43-81ee-451e-ab85-2e64a194960b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e27a2c0-0804-4420-9ba2-2eab843aa30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e27a2c0-0804-4420-9ba2-2eab843aa30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3d171-1b47-49a3-a850-3fe7ace72fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:32 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Volume a3828f43-81ee-451e-ab85-2e64a194960b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3828f43-81ee-451e-ab85-2e64a194960b', 'volume_size': 1}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=36b8299d-b637-44db-962c-b0f843663ff5,created_at=2025-09-23T13:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1261954948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36b8299d-b637-44db-962c-b0f843663ff5,host='devstack@QuobyteHD#QuobyteHD',id=a3828f43-81ee-451e-ab85-2e64a194960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:32Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa2ef770-d40b-4f5c-8045-b286f04016f3),volume_type_id=fa2ef770-d40b-4f5c-8045-b286f04016f3)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Creating volume a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:22:32 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:22:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:33 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=77, name=volume-a3828f43-81ee-451e-ab85-2e64a194960b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b 1073741824" returned: 0 in 0.598s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b" returned: 0 in 0.268s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] <== create_volume: return (1069ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:22:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3d171-1b47-49a3-a850-3fe7ace72fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3828f43-81ee-451e-ab85-2e64a194960b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac67eee-90ac-45c0-9ad8-30403e8dda84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:34 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:DELETE=4,cinder:SELECT=78,cinder:INSERT=19,cinder:UPDATE=102 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:22:34 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Volume volume-a3828f43-81ee-451e-ab85-2e64a194960b (a3828f43-81ee-451e-ab85-2e64a194960b): created successfully
Sep 23 15:22:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac67eee-90ac-45c0-9ad8-30403e8dda84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (09e51d2e-5745-4605-8391-4c82fcffb847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:34 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-082a33eb-722f-4eed-9731-384b907fba7a tempest-GroupSnapshotsTest-297693473 None] Created volume successfully.
Sep 23 15:22:35 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-903c6698-933a-481d-ae06-437b412dc573 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:35 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=93,cinder:UPDATE=94,cinder:INSERT=25,cinder:DELETE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:22:35 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-903c6698-933a-481d-ae06-437b412dc573 tempest-GroupSnapshotsTest-297693473 None] Update group completed successfully.
Sep 23 15:22:36 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-dd91dc43-c347-4d9e-b979-e43690192e0b tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-dd91dc43-c347-4d9e-b979-e43690192e0b tempest-GroupSnapshotsTest-297693473 None] Update group completed successfully.
Sep 23 15:22:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f25c7bee-8077-41c3-85a6-77b81fd3d30f tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:38 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f25c7bee-8077-41c3-85a6-77b81fd3d30f tempest-GroupSnapshotsTest-297693473 None] Update group completed successfully.
Sep 23 15:22:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-66b10c95-5e60-4b91-bf5d-792e09aee744 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:39 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-66b10c95-5e60-4b91-bf5d-792e09aee744 tempest-GroupSnapshotsTest-297693473 None] Update group completed successfully.
Sep 23 15:22:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] GroupSnapshot c551ea33-6c11-47de-be77-8f1c4171b1fb: creating.
Sep 23 15:22:41 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:41 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Group snapshot c551ea33-6c11-47de-be77-8f1c4171b1fb: creating. {{(pid=84009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 23 15:22:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Creating offline snapshot c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 of volume a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:22:41 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d873f4-f3ad-463a-a3ac-557f4cb2e9e9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:42 devstack quobyte-client[84024]: System call of process 95179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b" returned: 0 in 0.734s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:42 devstack quobyte-client[84024]: System call of process 95182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:42 devstack quobyte-client[84024]: System call of process 95182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:42 devstack quobyte-client[84024]: System call of process 95182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:42 devstack quobyte-client[84024]: System call of process 95182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:42 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=78, name=volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 1G" returned: 0 in 0.506s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a3828f43-81ee-451e-ab85-2e64a194960b -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:42 devstack quobyte-client[84024]: System call of process 95185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img rebase -u -b volume-a3828f43-81ee-451e-ab85-2e64a194960b -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" returned: 0 in 0.351s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" returned: 0 in 0.191s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" returned: 0 in 0.119s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.info" returned: 0 in 0.145s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.info" returned: 0 in 0.151s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Creating offline snapshot cfc96658-dd7b-48c3-9474-df0983e877f1 of volume da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:22:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce21f6c-2238-432f-98a2-b713a9e9cd94]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" returned: 0 in 0.587s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:45 devstack quobyte-client[84024]: System call of process 95195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:45 devstack quobyte-client[84024]: System call of process 95195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:45 devstack quobyte-client[84024]: System call of process 95195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:45 devstack quobyte-client[84024]: System call of process 95195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:45 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=80, name=volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 1G" returned: 0 in 0.323s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img rebase -u -b volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:45 devstack quobyte-client[84024]: System call of process 95198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img rebase -u -b volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1" returned: 0 in 0.172s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1" returned: 0 in 0.230s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1" returned: 0 in 0.154s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.info" returned: 0 in 0.134s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:22:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.info" returned: 0 in 0.132s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ce3edbe6-fc77-450e-a7a6-74ee307da96f tempest-GroupSnapshotsTest-297693473 None] group_snapshot c551ea33-6c11-47de-be77-8f1c4171b1fb: created successfully
Sep 23 15:22:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Flow 'volume_create_manager' (6e4aec5b-e44b-46e8-ada2-8e68c3d0aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6241a8-83a0-4ff4-84c4-b23d73090386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6241a8-83a0-4ff4-84c4-b23d73090386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-138476771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ce2d31-a3ad-4def-96b3-ac18e8016f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff4abb404154e72af351fbf2ceabbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:47Z,use_quota=True,user_id='bcdeaef77aa549c78bcfcdfdc19b1a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1645abcf-313f-480e-89c1-8aa8fee063cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1645abcf-313f-480e-89c1-8aa8fee063cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cde1262-10d8-4920-b075-fd5ddd4730fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cde1262-10d8-4920-b075-fd5ddd4730fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ce2d31-a3ad-4def-96b3-ac18e8016f0c', 'volume_name': 'volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1172f26-a9e9-45f6-9453-ed14003ed0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1172f26-a9e9-45f6-9453-ed14003ed0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9a916-6f05-4b86-a8dd-7090e0deea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:47 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Volume a6ce2d31-a3ad-4def-96b3-ac18e8016f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c', 'volume_size': 1}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-138476771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ce2d31-a3ad-4def-96b3-ac18e8016f0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff4abb404154e72af351fbf2ceabbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:22:47Z,use_quota=True,user_id='bcdeaef77aa549c78bcfcdfdc19b1a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Creating volume a6ce2d31-a3ad-4def-96b3-ac18e8016f0c {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:22:47 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:22:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:47 devstack quobyte-client[84024]: System call of process 95208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:47 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=82, name=volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c 1073741824" returned: 0 in 0.454s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c" returned: 0 in 0.191s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] group_snapshot c551ea33-6c11-47de-be77-8f1c4171b1fb: deleting
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a9a916-6f05-4b86-a8dd-7090e0deea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25e794e-fca9-451e-9604-787c073a0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:22:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] group_snapshot c551ea33-6c11-47de-be77-8f1c4171b1fb: deleting {{(pid=84009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-a3828f43-81ee-451e-ab85-2e64a194960b" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Volume volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c (a6ce2d31-a3ad-4def-96b3-ac18e8016f0c): created successfully
Sep 23 15:22:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25e794e-fca9-451e-9604-787c073a0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Flow 'volume_create_manager' (6e4aec5b-e44b-46e8-ada2-8e68c3d0aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:22:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5465762b-311a-413c-84e2-72d6599f452e tempest-VolumesMetadataTest-475777694 None] Created volume successfully.
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-a3828f43-81ee-451e-ab85-2e64a194960b" acquired by "delete_snapshot" :: waited 0.114s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Deleting offline snapshot c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 of volume a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] snapshot_file for this snap is: volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a389ec7c-502d-4a16-88bc-0a0e7a80f903]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" returned: 0 in 0.857s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3828f43-81ee-451e-ab85-2e64a194960b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:22:50 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc7af10-1c27-4c72-b750-537fa6e8fb48]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:50 devstack quobyte-client[84024]: System call of process 95215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:50 devstack quobyte-client[84024]: System call of process 95215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b" returned: 0 in 0.880s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:51 devstack quobyte-client[84024]: System call of process 95221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:51 devstack quobyte-client[84024]: System call of process 95221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:51 devstack quobyte-client[84024]: System call of process 95221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Acquiring lock "cinder-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" returned: 0 in 1.095s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Lock "cinder-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c-delete_volume" acquired by "delete_volume" :: waited 0.573s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b.c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" returned: 0 in 0.524s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-c668d32a-ee1a-4563-95eb-ed9bf7e11bd5" released by "_delete_snapshot" :: held 3.935s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-a3828f43-81ee-451e-ab85-2e64a194960b" released by "delete_snapshot" :: held 3.996s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Acquiring lock "cinder-quobyte-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Lock "cinder-quobyte-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" acquired by "delete_snapshot" :: waited 0.070s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-cfc96658-dd7b-48c3-9474-df0983e877f1" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50fb07-65d9-451b-9b6f-52fe0070e595]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-cfc96658-dd7b-48c3-9474-df0983e877f1" acquired by "_delete_snapshot" :: waited 0.322s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Deleting offline snapshot cfc96658-dd7b-48c3-9474-df0983e877f1 of volume da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] snapshot_file for this snap is: volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8f7e3-b270-460f-88b8-2325299e0ba9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:54 devstack quobyte-client[84024]: System call of process 95240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:54 devstack quobyte-client[84024]: System call of process 95240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c" returned: 0 in 1.090s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:54 devstack quobyte-client[84024]: System call of process 95241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:54 devstack quobyte-client[84024]: System call of process 95241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:54 devstack quobyte-client[84024]: System call of process 95241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c" returned: 0 in 0.404s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1" returned: 0 in 1.256s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:22:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Lock "cinder-quobyte-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c" released by "delete_volume" :: held 1.831s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:55 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6541cc-00ff-4208-b789-b512cab7fa42]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:22:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:56 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Created reservations ['d0f1078d-f1bc-474a-bc8d-9a1204c50f21', '8c64783b-1630-429c-936a-aed30abb384a', '44f201cd-c757-427b-a661-357229a717d7', 'db3c3c86-cc10-4940-855d-c1baf202f58c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:56 devstack quobyte-client[84024]: System call of process 95252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:56 devstack quobyte-client[84024]: System call of process 95252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:56 devstack quobyte-client[84024]: System call of process 95252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" returned: 0 in 0.979s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:56 devstack quobyte-client[84024]: System call of process 95260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:22:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1" returned: 0 in 0.616s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.045s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996.cfc96658-dd7b-48c3-9474-df0983e877f1" returned: 0 in 0.767s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-cfc96658-dd7b-48c3-9474-df0983e877f1" released by "_delete_snapshot" :: held 4.318s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.589s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:22:57 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:22:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Deleted volume successfully.
Sep 23 15:22:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" released by "delete_snapshot" :: held 4.937s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fc545cee-619c-4c70-a211-8c5a9ad984c2 tempest-VolumesMetadataTest-475777694 None] Lock "cinder-a6ce2d31-a3ad-4def-96b3-ac18e8016f0c-delete_volume" released by "delete_volume" :: held 5.747s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:22:58 devstack cinder-volume[84009]: WARNING cinder.quota [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2086635574 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2086635574, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:58 devstack cinder-volume[84009]: WARNING cinder.quota [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2086635574 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2086635574, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:22:58 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Created reservations ['fc64640e-8360-49b7-ae5b-48bb13ce2edb', '220d187e-e4cc-4acd-9ad0-7cb7c2dd5d3a', '7f8a1611-92e6-45bf-b628-385d44ea5972', '047f3c17-910d-498b-a573-1a2f33584ab0'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:58 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] Created reservations ['7ae72f50-8ab5-41a0-8a72-de538271893f', '989a2eaa-aa60-4d08-8d83-d4edd275b938', 'a7bf37fd-266f-41b6-9830-60b2ab999ad3', 'e10273b7-a09e-4047-a551-3cfa740341bf'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:22:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2612bef8-7341-4223-bb43-83d82f3bf14c tempest-GroupSnapshotsTest-297693473 None] group_snapshot c551ea33-6c11-47de-be77-8f1c4171b1fb: deleted successfully
Sep 23 15:23:00 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-a3828f43-81ee-451e-ab85-2e64a194960b" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-a3828f43-81ee-451e-ab85-2e64a194960b" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:00 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[220067eb-81ef-4b44-897d-f48bf55da004]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:00 devstack quobyte-client[84024]: System call of process 95273 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b" returned: 0 in 0.562s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a3828f43-81ee-451e-ab85-2e64a194960b" returned: 0 in 0.165s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-a3828f43-81ee-451e-ab85-2e64a194960b" released by "delete_volume" :: held 1.026s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" acquired by "delete_volume" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99104d3-4b61-445c-b638-a1aa7f461979]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" returned: 0 in 0.711s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" returned: 0 in 0.226s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-da852c07-ecf8-4a1d-b5ec-71d9e91e9996" released by "delete_volume" :: held 1.456s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:03 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['5f06229a-fd31-4727-a4b3-1bd71854c22f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:03 devstack cinder-volume[84009]: WARNING cinder.quota [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2086635574 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2086635574, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:23:03 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['1a41280c-b714-489e-8935-576f0a772ea9', '4ec88a21-6dc8-472a-b5ab-3b7a09457d20', 'c3d64746-2e70-49a0-b01a-8d66b3bf121a', '24288b20-0aa9-4e57-8408-a002cfdc0367'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:04 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Flow 'volume_create_manager' (66de6cfd-2b04-42e3-b248-78c800f8fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e618d3-3c6b-4e11-b82d-4ca8066966dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e618d3-3c6b-4e11-b82d-4ca8066966dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2066287130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c779595f-872a-49f3-a45d-77326d8305dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d357b64a8e4e4725bf353893cd58dbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:03Z,use_quota=True,user_id='038d56026f2b47778bfcdac26d81af5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0a0513-5405-44b0-aeb7-d0e76807d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0a0513-5405-44b0-aeb7-d0e76807d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6531a796-d85a-4379-b976-6b6b1b97d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6531a796-d85a-4379-b976-6b6b1b97d625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c779595f-872a-49f3-a45d-77326d8305dc', 'volume_name': 'volume-c779595f-872a-49f3-a45d-77326d8305dc', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36936bdf-86a4-478c-bda3-262759ba8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36936bdf-86a4-478c-bda3-262759ba8480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abb68a4-8beb-4574-b31f-877ef7eb86ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:04 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Volume c779595f-872a-49f3-a45d-77326d8305dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c779595f-872a-49f3-a45d-77326d8305dc', 'volume_size': 1}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2066287130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c779595f-872a-49f3-a45d-77326d8305dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d357b64a8e4e4725bf353893cd58dbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:03Z,use_quota=True,user_id='038d56026f2b47778bfcdac26d81af5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Creating volume c779595f-872a-49f3-a45d-77326d8305dc {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:23:04 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:23:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:05 devstack quobyte-client[84024]: System call of process 95319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:05 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=83, name=volume-c779595f-872a-49f3-a45d-77326d8305dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc 1073741824" returned: 0 in 1.435s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:06 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['5f86a7a3-b981-49c9-9de4-48ad8dff911d', '3c1efa6e-eb40-4fab-899c-a31339b82308', 'b6b9d549-ee75-4142-bd2d-9ac1379d1c8d', '7254e84c-ed94-4928-be2b-380c1e0ac2fc'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc" returned: 0 in 0.743s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] <== create_volume: return (2287ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:23:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abb68a4-8beb-4574-b31f-877ef7eb86ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c779595f-872a-49f3-a45d-77326d8305dc', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2561d6-8e1b-45e8-8ce6-fef45a9a29bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:07 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Volume volume-c779595f-872a-49f3-a45d-77326d8305dc (c779595f-872a-49f3-a45d-77326d8305dc): created successfully
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2561d6-8e1b-45e8-8ce6-fef45a9a29bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Flow 'volume_create_manager' (66de6cfd-2b04-42e3-b248-78c800f8fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:07 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-41d40d32-63e6-49f7-beb4-5ae3d6038c74 tempest-VolumesTransfersTest-110281101 None] Created volume successfully.
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.250s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:07 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:23:08 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0ca1c9b1-cf8e-4229-b6bd-df754f87afb9 tempest-GroupSnapshotsTest-297693473 None] Delete group completed successfully.
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-63cba11c-6c7c-4fdc-a604-83d41e3a4f30 tempest-VolumesTransfersTest-1296607446 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c6dff18a-645f-416a-97cf-dd755e4f04d6 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c6dff18a-645f-416a-97cf-dd755e4f04d6 tempest-GroupSnapshotsTest-297693473 None] Group tempest-GroupSnapshotsTest-Group-655213407: creating
Sep 23 15:23:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.891s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:23:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-63cba11c-6c7c-4fdc-a604-83d41e3a4f30 tempest-VolumesTransfersTest-1296607446 None] Transfer volume completed successfully.
Sep 23 15:23:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c6dff18a-645f-416a-97cf-dd755e4f04d6 tempest-GroupSnapshotsTest-297693473 None] Group tempest-GroupSnapshotsTest-Group-655213407: created successfully
Sep 23 15:23:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c6dff18a-645f-416a-97cf-dd755e4f04d6 tempest-GroupSnapshotsTest-297693473 None] Create group completed successfully.
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Acquiring lock "cinder-c779595f-872a-49f3-a45d-77326d8305dc-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-c779595f-872a-49f3-a45d-77326d8305dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Acquiring lock "cinder-quobyte-c779595f-872a-49f3-a45d-77326d8305dc" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-quobyte-c779595f-872a-49f3-a45d-77326d8305dc" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ebf889-1e8a-4b26-a746-616312e9a653]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc" returned: 0 in 0.619s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c779595f-872a-49f3-a45d-77326d8305dc" returned: 0 in 0.240s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-quobyte-c779595f-872a-49f3-a45d-77326d8305dc" released by "delete_volume" :: held 1.612s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:12 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (845fc6d5-5876-4c78-bd16-c8ba378902ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9606bf7-0061-4f52-9f85-ea4656f21164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9606bf7-0061-4f52-9f85-ea4656f21164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052472809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41cfbde6-6f30-44bd-9ce2-1930581831f8,host='devstack@QuobyteHD#QuobyteHD',id=69240177-cdfd-4c83-9ab5-dbbc1e1e8b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:12Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d32ac6f0-24de-4413-b600-004c2bd00cec),volume_type_id=d32ac6f0-24de-4413-b600-004c2bd00cec)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0a51d9-97a1-4afc-bf7b-c2bd11e9a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0a51d9-97a1-4afc-bf7b-c2bd11e9a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdbeaf5-bbf3-4777-93e8-c0170ce3af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdbeaf5-bbf3-4777-93e8-c0170ce3af9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69240177-cdfd-4c83-9ab5-dbbc1e1e8b56', 'volume_name': 'volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71facbd4-608a-4f03-8605-c343e2c9558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71facbd4-608a-4f03-8605-c343e2c9558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaa3d17-54c5-4b7b-9b06-6a24254017d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Volume 69240177-cdfd-4c83-9ab5-dbbc1e1e8b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56', 'volume_size': 1}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41cfbde6-6f30-44bd-9ce2-1930581831f8,created_at=2025-09-23T13:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052472809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41cfbde6-6f30-44bd-9ce2-1930581831f8,host='devstack@QuobyteHD#QuobyteHD',id=69240177-cdfd-4c83-9ab5-dbbc1e1e8b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a8d4a278c54ac4847cb0d02728cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:12Z,use_quota=True,user_id='b45428a962444126b1b2b205b30434a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d32ac6f0-24de-4413-b600-004c2bd00cec),volume_type_id=d32ac6f0-24de-4413-b600-004c2bd00cec)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Creating volume 69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:23:13 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:13 devstack quobyte-client[84024]: System call of process 95371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:13 devstack quobyte-client[84024]: System call of process 95371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=84, name=volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Created reservations ['12b33fe6-4dc3-4ac2-84c5-77778564ca8f', '88f06a73-5dcf-4c46-93f1-67c0fd0eac9b', '30fb7b56-966b-4c94-8b31-08cea59605ae', '99440492-0c68-44b0-bb67-286a37386f76'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 1073741824" returned: 0 in 0.697s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" returned: 0 in 0.562s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] <== create_volume: return (1297ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaa3d17-54c5-4b7b-9b06-6a24254017d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431235e2-b10f-480a-bcce-24f4fe1c97f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.807s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:23:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Deleted volume successfully.
Sep 23 15:23:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Volume volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 (69240177-cdfd-4c83-9ab5-dbbc1e1e8b56): created successfully
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431235e2-b10f-480a-bcce-24f4fe1c97f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Flow 'volume_create_manager' (845fc6d5-5876-4c78-bd16-c8ba378902ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-236babe4-f8ae-4da5-87d2-6bfc5e5e5ee0 tempest-GroupSnapshotsTest-297693473 None] Created volume successfully.
Sep 23 15:23:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65fa77c8-876d-47dd-8156-668408b93fc5 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-c779595f-872a-49f3-a45d-77326d8305dc-delete_volume" released by "delete_volume" :: held 4.529s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Flow 'volume_create_manager' (3a13fbdb-57b8-4b38-87b3-775017a75b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d7c5a4-70cb-4be9-8019-f9c4ee578ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d7c5a4-70cb-4be9-8019-f9c4ee578ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1370605170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9e673b-8253-437c-857a-938fa186eb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d357b64a8e4e4725bf353893cd58dbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:16Z,use_quota=True,user_id='038d56026f2b47778bfcdac26d81af5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ed6bbe-01e9-415b-9de1-425a565b018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ed6bbe-01e9-415b-9de1-425a565b018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaf7fa6-69b3-49ab-93f5-46ddf809207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaf7fa6-69b3-49ab-93f5-46ddf809207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9e673b-8253-437c-857a-938fa186eb8a', 'volume_name': 'volume-7a9e673b-8253-437c-857a-938fa186eb8a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8e7ed2-d88a-43a9-b581-811ebfcdb889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8e7ed2-d88a-43a9-b581-811ebfcdb889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42508120-730d-4c23-87fe-2c4376a2e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Volume 7a9e673b-8253-437c-857a-938fa186eb8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9e673b-8253-437c-857a-938fa186eb8a', 'volume_size': 1}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1370605170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9e673b-8253-437c-857a-938fa186eb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d357b64a8e4e4725bf353893cd58dbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:16Z,use_quota=True,user_id='038d56026f2b47778bfcdac26d81af5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Creating volume 7a9e673b-8253-437c-857a-938fa186eb8a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:23:16 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:16 devstack quobyte-client[84024]: System call of process 95377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:16 devstack quobyte-client[84024]: System call of process 95377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:16 devstack quobyte-client[84024]: System call of process 95377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:16 devstack quobyte-client[84024]: System call of process 95377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:16 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=85, name=volume-7a9e673b-8253-437c-857a-938fa186eb8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] GroupSnapshot 86493208-24c0-4337-b934-ffc688b7bb90: creating.
Sep 23 15:23:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Group snapshot 86493208-24c0-4337-b934-ffc688b7bb90: creating. {{(pid=84009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a 1073741824" returned: 0 in 0.599s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Flow 'volume_create_manager' (77de03a2-be75-4050-8b25-27256eb66a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5314b24-8bbf-4880-904f-7840b752a2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a" returned: 0 in 0.509s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5314b24-8bbf-4880-904f-7840b752a2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1585965777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535619de0d8a400b99a3849296cf995b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:16Z,use_quota=True,user_id='fe8448ac535c4c8a9cff4f79e46dd86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47ae456-e2d3-4a5f-b86d-46be5f469f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47ae456-e2d3-4a5f-b86d-46be5f469f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ada81cd-6526-4083-92d4-be403428af88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ada81cd-6526-4083-92d4-be403428af88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676', 'volume_name': 'volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74676d4f-a787-4050-b275-f06115730865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74676d4f-a787-4050-b275-f06115730865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0569d4-aa5f-4682-976b-18f14a113953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:17 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Volume df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676', 'volume_size': 1}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] <== create_volume: return (1193ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.609s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Creating offline snapshot a8c15386-10f0-449b-8007-ad8dc83f2607 of volume 69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42508120-730d-4c23-87fe-2c4376a2e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9e673b-8253-437c-857a-938fa186eb8a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1250ef25-8406-4bfa-9d69-baf61d4ad1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab8540e-7a54-48f8-baba-d623c6ac64f9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Volume volume-7a9e673b-8253-437c-857a-938fa186eb8a (7a9e673b-8253-437c-857a-938fa186eb8a): created successfully
Sep 23 15:23:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1250ef25-8406-4bfa-9d69-baf61d4ad1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Flow 'volume_create_manager' (3a13fbdb-57b8-4b38-87b3-775017a75b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e51f4774-fb04-4bcf-a9ea-dca9c5c4cb71 tempest-VolumesTransfersTest-110281101 None] Created volume successfully.
Sep 23 15:23:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" returned: 0 in 0.715s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:18 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=86, name=volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Acquiring lock "cinder-7a9e673b-8253-437c-857a-938fa186eb8a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 1G" returned: 0 in 0.566s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img rebase -u -b volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:19 devstack quobyte-client[84024]: System call of process 95387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-7a9e673b-8253-437c-857a-938fa186eb8a-delete_volume" acquired by "delete_volume" :: waited 0.325s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img rebase -u -b volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607" returned: 0 in 0.399s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607" returned: 0 in 0.442s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:23:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Acquiring lock "cinder-quobyte-7a9e673b-8253-437c-857a-938fa186eb8a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607" returned: 0 in 0.307s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-quobyte-7a9e673b-8253-437c-857a-938fa186eb8a" acquired by "delete_volume" :: waited 0.253s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[05448d73-57a3-4998-be5b-673e0c34b0ff]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.info" returned: 0 in 0.286s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.info" returned: 0 in 0.181s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1585965777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='535619de0d8a400b99a3849296cf995b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:16Z,use_quota=True,user_id='fe8448ac535c4c8a9cff4f79e46dd86d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Creating volume df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:23:21 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: System call of process 95395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:21 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=88, name=volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a" returned: 0 in 0.968s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 1073741824" returned: 0 in 0.777s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7a9e673b-8253-437c-857a-938fa186eb8a" returned: 0 in 0.883s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] group_snapshot 86493208-24c0-4337-b934-ffc688b7bb90: deleting
Sep 23 15:23:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-quobyte-7a9e673b-8253-437c-857a-938fa186eb8a" released by "delete_volume" :: held 2.422s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" returned: 0 in 0.937s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] <== create_volume: return (1811ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:23:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] group_snapshot 86493208-24c0-4337-b934-ffc688b7bb90: deleting {{(pid=84009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 23 15:23:23 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d5fff40b-842b-48db-ad0f-a1d2050c16d6 tempest-GroupSnapshotsTest-297693473 None] group_snapshot 86493208-24c0-4337-b934-ffc688b7bb90: created successfully
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0569d4-aa5f-4682-976b-18f14a113953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e603f64-4cdb-461c-bd11-c2749cb3824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:23 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Volume volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 (df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676): created successfully
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e603f64-4cdb-461c-bd11-c2749cb3824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Flow 'volume_create_manager' (77de03a2-be75-4050-8b25-27256eb66a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Created reservations ['ea59b73d-3be8-4fee-b780-833491698d76', '71f5592c-77a5-499b-bd44-b2795a88a9f2', '86042a4c-ebc6-4c9e-b5f9-c57e7b98c134', '8e7dff29-2c4c-46ed-b429-8d6429c1284b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-a8c15386-10f0-449b-8007-ad8dc83f2607" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:23 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-171fd543-4af3-4fb5-9cbb-a8a66c3a9b26 tempest-TestMinimumBasicScenario-48379546 None] Created volume successfully.
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-a8c15386-10f0-449b-8007-ad8dc83f2607" acquired by "_delete_snapshot" :: waited 0.406s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Deleting offline snapshot a8c15386-10f0-449b-8007-ad8dc83f2607 of volume 69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] snapshot_file for this snap is: volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.458s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:23 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:23:24 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9eef46-88a7-4bf0-a987-125663912e90]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:24 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Deleted volume successfully.
Sep 23 15:23:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fe12b68a-8a45-4d69-9338-ca8f3ff89023 tempest-VolumesTransfersTest-1417647355 None] Lock "cinder-7a9e673b-8253-437c-857a-938fa186eb8a-delete_volume" released by "delete_volume" :: held 5.728s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:25 devstack quobyte-client[84024]: System call of process 95435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607" returned: 0 in 1.327s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:23:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b72319-5ac4-4d4a-92b5-bf161d6bbbf1]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:26 devstack quobyte-client[84024]: System call of process 95438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" returned: 0 in 0.857s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:26 devstack quobyte-client[84024]: System call of process 95442 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607" returned: 0 in 0.331s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56.a8c15386-10f0-449b-8007-ad8dc83f2607" returned: 0 in 0.194s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-a8c15386-10f0-449b-8007-ad8dc83f2607" released by "_delete_snapshot" :: held 3.455s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" released by "delete_snapshot" :: held 3.905s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:28 devstack cinder-volume[84009]: WARNING cinder.quota [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1160877061 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1160877061, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:23:28 devstack cinder-volume[84009]: WARNING cinder.quota [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1160877061 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1160877061, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:23:28 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] Created reservations ['acdfdbd2-3e23-4791-b9e5-dd3bd53c9dd0', 'cf419a28-1418-4ac0-ba3c-de63a43f933f', '4800f01f-2382-42f5-b69c-2458547639ad', 'b3771f72-7da7-4b8d-b00f-2f624e63cf57'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:28 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8fd1f0cc-25dc-486a-8ac8-c5c78dc43c0d tempest-GroupSnapshotsTest-297693473 None] group_snapshot 86493208-24c0-4337-b934-ffc688b7bb90: deleted successfully
Sep 23 15:23:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "cinder-quobyte-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" acquired by "delete_volume" :: waited 0.069s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:30 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fba0a8-20ea-4893-ab0e-80b453e7e664]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e43609-3401-4587-9297-db6dff36983f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" returned: 0 in 1.739s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" returned: 0 in 0.496s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:32 devstack quobyte-client[84024]: System call of process 95465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:32 devstack quobyte-client[84024]: System call of process 95465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:32 devstack quobyte-client[84024]: System call of process 95465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:32 devstack quobyte-client[84024]: System call of process 95465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Lock "cinder-quobyte-69240177-cdfd-4c83-9ab5-dbbc1e1e8b56" released by "delete_volume" :: held 2.694s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" returned: 0 in 1.343s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.469s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8409f2c6-4312-458f-ab5f-fabb4d7a26da', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:23:33 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:33 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['ef9a06e9-7869-4079-8443-548d9699e3e8'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:33 devstack cinder-volume[84009]: WARNING cinder.quota [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1160877061 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1160877061, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:23:34 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-54b65049-7828-4a72-b4d5-1bcdb1064a15 req-f09de859-e416-411d-b25d-299bb99d08a2 tempest-TestMinimumBasicScenario-48379546 None] attachment_update completed successfully.
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Created reservations ['e50099f1-2d70-456f-9e2e-a66edf0e727a', '3ed4dbb0-8266-47ee-841e-b8fb6d0443e3', '810efa69-afd2-4307-85bd-06ffcf9c06a2', '1638b8e6-b4c4-4417-af5e-42132cb3030f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=83,cinder:UPDATE=70,cinder:INSERT=24,cinder:DELETE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.509s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:35 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:23:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5bc4a08f-36fe-4fe6-909b-70f76880bf09 tempest-GroupSnapshotsTest-297693473 None] Delete group completed successfully.
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=93,cinder:UPDATE=116,cinder:DELETE=5,cinder:INSERT=14 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:23:44 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Flow 'volume_create_manager' (ee285413-d633-443a-81bf-b18c0642ecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df63cf1-d6ea-4fd1-95be-52a2c82d5899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df63cf1-d6ea-4fd1-95be-52a2c82d5899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2026604956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f2c7a1-f801-4486-8e9b-23e5361c7694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c2f3060f014a0d8442bbe6c838ec4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:44Z,use_quota=True,user_id='864f19c2169642db988874f582093bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07900128-4245-4f56-ae0c-d0a1ef5cc406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07900128-4245-4f56-ae0c-d0a1ef5cc406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1586b6-495b-4836-b778-fd69dd98f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1586b6-495b-4836-b778-fd69dd98f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f2c7a1-f801-4486-8e9b-23e5361c7694', 'volume_name': 'volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5935d20-7e5a-4f4f-9f9f-f299c19ea5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5935d20-7e5a-4f4f-9f9f-f299c19ea5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bedff1-c1b9-4347-8a6f-b73c90e41dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:44 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Volume c6f2c7a1-f801-4486-8e9b-23e5361c7694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694', 'volume_size': 1}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2026604956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f2c7a1-f801-4486-8e9b-23e5361c7694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c2f3060f014a0d8442bbe6c838ec4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:44Z,use_quota=True,user_id='864f19c2169642db988874f582093bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Creating volume c6f2c7a1-f801-4486-8e9b-23e5361c7694 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:23:44 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:23:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:44 devstack quobyte-client[84024]: System call of process 95869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:44 devstack quobyte-client[84024]: System call of process 95869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:44 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=89, name=volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694 1073741824" returned: 0 in 0.575s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694" returned: 0 in 0.265s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:23:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bedff1-c1b9-4347-8a6f-b73c90e41dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd226826-fa29-4e26-a232-f7926c0cbaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:46 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Volume volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694 (c6f2c7a1-f801-4486-8e9b-23e5361c7694): created successfully
Sep 23 15:23:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd226826-fa29-4e26-a232-f7926c0cbaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Flow 'volume_create_manager' (ee285413-d633-443a-81bf-b18c0642ecf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-dbdc19f5-5cda-44ee-9a74-5fbba4870951 tempest-VolumesTransfersV355Test-1541333454 None] Created volume successfully.
Sep 23 15:23:48 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6fa4d8e2-845f-41bd-9306-ee911d797189 tempest-VolumesTransfersV355Test-682610957 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6fa4d8e2-845f-41bd-9306-ee911d797189 tempest-VolumesTransfersV355Test-682610957 None] Transfer volume completed successfully.
Sep 23 15:23:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Acquiring lock "cinder-c6f2c7a1-f801-4486-8e9b-23e5361c7694-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-c6f2c7a1-f801-4486-8e9b-23e5361c7694-delete_volume" acquired by "delete_volume" :: waited 0.258s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Acquiring lock "cinder-quobyte-c6f2c7a1-f801-4486-8e9b-23e5361c7694" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-quobyte-c6f2c7a1-f801-4486-8e9b-23e5361c7694" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:50 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[98477a48-c4b7-43e2-9677-ccbeddd0c947]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:51 devstack quobyte-client[84024]: System call of process 95920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694" returned: 0 in 0.954s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6f2c7a1-f801-4486-8e9b-23e5361c7694" returned: 0 in 0.266s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-quobyte-c6f2c7a1-f801-4486-8e9b-23e5361c7694" released by "delete_volume" :: held 1.627s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:52 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Created reservations ['4ba440fc-9fa2-4623-b0ed-24f8310d9479', '27ba2617-557b-41a4-b8fc-371d9093d5ea', 'f858ccf2-a713-4e6e-b23f-4a3a63f9be1c', 'ebeba1f2-eea5-4764-8538-88ead275275a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.260s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:53 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:23:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Deleted volume successfully.
Sep 23 15:23:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-316a4832-b694-4d2b-8dde-7f90f34e7d2c tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-c6f2c7a1-f801-4486-8e9b-23e5361c7694-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Flow 'volume_create_manager' (2a4ced5f-f800-45d3-b5e7-0398cc7f60b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba614aaa-b531-4fce-b612-518136a51caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba614aaa-b531-4fce-b612-518136a51caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-171382739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6caaf2c-c085-42aa-840b-39637394fd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c2f3060f014a0d8442bbe6c838ec4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:55Z,use_quota=True,user_id='864f19c2169642db988874f582093bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b9588c-dd56-41dc-9a1e-835e3f7d7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b9588c-dd56-41dc-9a1e-835e3f7d7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941f82a9-326f-4021-986a-651ddc10594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941f82a9-326f-4021-986a-651ddc10594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6caaf2c-c085-42aa-840b-39637394fd7a', 'volume_name': 'volume-a6caaf2c-c085-42aa-840b-39637394fd7a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95fecab-1c87-4d8b-8f7f-d5700d3ec704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95fecab-1c87-4d8b-8f7f-d5700d3ec704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56283259-1558-432d-a41f-f3152d5c1faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:55 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Volume a6caaf2c-c085-42aa-840b-39637394fd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6caaf2c-c085-42aa-840b-39637394fd7a', 'volume_size': 1}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-171382739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6caaf2c-c085-42aa-840b-39637394fd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c2f3060f014a0d8442bbe6c838ec4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:23:55Z,use_quota=True,user_id='864f19c2169642db988874f582093bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Creating volume a6caaf2c-c085-42aa-840b-39637394fd7a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:23:55 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:23:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:56 devstack quobyte-client[84024]: System call of process 95925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:56 devstack quobyte-client[84024]: System call of process 95925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:56 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=90, name=volume-a6caaf2c-c085-42aa-840b-39637394fd7a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:23:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a 1073741824" returned: 0 in 0.643s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a" returned: 0 in 0.255s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] <== create_volume: return (1045ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:23:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:23:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56283259-1558-432d-a41f-f3152d5c1faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6caaf2c-c085-42aa-840b-39637394fd7a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdab49f-0a73-40bf-8805-9d8ce109447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:23:57 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Volume volume-a6caaf2c-c085-42aa-840b-39637394fd7a (a6caaf2c-c085-42aa-840b-39637394fd7a): created successfully
Sep 23 15:23:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdab49f-0a73-40bf-8805-9d8ce109447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:23:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Flow 'volume_create_manager' (2a4ced5f-f800-45d3-b5e7-0398cc7f60b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:23:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8463ae2a-45e5-47a7-b01c-6fe7bd1994d6 tempest-VolumesTransfersV355Test-1541333454 None] Created volume successfully.
Sep 23 15:23:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Acquiring lock "cinder-a6caaf2c-c085-42aa-840b-39637394fd7a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-a6caaf2c-c085-42aa-840b-39637394fd7a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:58 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Acquiring lock "cinder-quobyte-a6caaf2c-c085-42aa-840b-39637394fd7a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:23:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-quobyte-a6caaf2c-c085-42aa-840b-39637394fd7a" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:23:58 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[157a1cf3-2240-4355-bc6d-0db99be05156]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:23:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:59 devstack quobyte-client[84024]: System call of process 95954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:59 devstack quobyte-client[84024]: System call of process 95954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:59 devstack quobyte-client[84024]: System call of process 95954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:23:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a" returned: 0 in 0.815s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:23:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-85641fe7-cc53-43ee-9965-837b7fa0c50c tempest-GroupsV320Test-1993239849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:23:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-85641fe7-cc53-43ee-9965-837b7fa0c50c tempest-GroupsV320Test-1993239849 None] Group tempest-GroupsV320Test-Group-650962610: creating
Sep 23 15:23:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a6caaf2c-c085-42aa-840b-39637394fd7a" returned: 0 in 0.467s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:23:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-quobyte-a6caaf2c-c085-42aa-840b-39637394fd7a" released by "delete_volume" :: held 1.501s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:23:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-85641fe7-cc53-43ee-9965-837b7fa0c50c tempest-GroupsV320Test-1993239849 None] Group tempest-GroupsV320Test-Group-650962610: created successfully
Sep 23 15:23:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-85641fe7-cc53-43ee-9965-837b7fa0c50c tempest-GroupsV320Test-1993239849 None] Create group completed successfully.
Sep 23 15:23:59 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Created reservations ['965e5c7e-ec95-4ce8-878a-94a07bf9c387', '57182ab1-5e2d-46e5-b809-fb2f3673e89d', '8800ceaa-bbaa-4848-9b36-e91337aa0650', '981c13a6-4764-4add-92d7-b2e019afcd33'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.124s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:24:00 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Deleted volume successfully.
Sep 23 15:24:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-65cc899d-95c3-48b0-a50b-2dfaeeded612 tempest-VolumesTransfersV355Test-1144545220 None] Lock "cinder-a6caaf2c-c085-42aa-840b-39637394fd7a-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Created reservations ['4becc958-6125-4f99-855e-95e74c50af84'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.154s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:01 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:24:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-91d3b7e2-25fb-4003-aa51-9542d6b195b5 tempest-GroupsV320Test-1993239849 None] Delete group completed successfully.
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.209s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:24:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Flow 'volume_create_manager' (25419772-3de1-46d8-8c06-cc96f844a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743e265e-a2d4-4699-8dd4-288a204530be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743e265e-a2d4-4699-8dd4-288a204530be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1734469643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4285bd-2256-4913-b5ba-b8c9935c98d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d94c40eafc45a5a3334c0d86083d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:10Z,use_quota=True,user_id='929fd026d01f4c61a72f3a7b5723a00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52127da8-c62e-40a3-b02e-1975482aefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52127da8-c62e-40a3-b02e-1975482aefda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9b7b53-e3fa-4315-81b1-eb1db6466ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9b7b53-e3fa-4315-81b1-eb1db6466ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4285bd-2256-4913-b5ba-b8c9935c98d7', 'volume_name': 'volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13925b51-fd0b-4e48-91ab-c81ee0abb131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13925b51-fd0b-4e48-91ab-c81ee0abb131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99991507-9cfe-4439-a404-4dd64324da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Volume ce4285bd-2256-4913-b5ba-b8c9935c98d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7', 'volume_size': 1}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1734469643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4285bd-2256-4913-b5ba-b8c9935c98d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d94c40eafc45a5a3334c0d86083d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:10Z,use_quota=True,user_id='929fd026d01f4c61a72f3a7b5723a00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Creating volume ce4285bd-2256-4913-b5ba-b8c9935c98d7 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:24:10 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:24:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:11 devstack quobyte-client[84024]: System call of process 95981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:11 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=91, name=volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:24:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7 1073741824" returned: 0 in 0.821s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7" returned: 0 in 0.129s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] <== create_volume: return (1066ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:24:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99991507-9cfe-4439-a404-4dd64324da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61357877-a631-47b9-a456-86ccbcec4275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Volume volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7 (ce4285bd-2256-4913-b5ba-b8c9935c98d7): created successfully
Sep 23 15:24:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61357877-a631-47b9-a456-86ccbcec4275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Flow 'volume_create_manager' (25419772-3de1-46d8-8c06-cc96f844a794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4b50dc0c-88ab-420b-a6c3-808b6f30f0bd tempest-VolumesTransfersV357Test-1041198883 None] Created volume successfully.
Sep 23 15:24:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8f9fd057-5cc1-4f48-9169-eb18b4807682 tempest-VolumesTransfersV357Test-2110507466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8f9fd057-5cc1-4f48-9169-eb18b4807682 tempest-VolumesTransfersV357Test-2110507466 None] Transfer volume completed successfully.
Sep 23 15:24:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Acquiring lock "cinder-ce4285bd-2256-4913-b5ba-b8c9935c98d7-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:24:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-ce4285bd-2256-4913-b5ba-b8c9935c98d7-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:24:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Acquiring lock "cinder-quobyte-ce4285bd-2256-4913-b5ba-b8c9935c98d7" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:24:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-quobyte-ce4285bd-2256-4913-b5ba-b8c9935c98d7" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:24:16 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7eb9be-d2d4-4b21-a20c-015b45d4db59]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:24:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:17 devstack quobyte-client[84024]: System call of process 95988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:17 devstack quobyte-client[84024]: System call of process 95988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7" returned: 0 in 0.815s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ce4285bd-2256-4913-b5ba-b8c9935c98d7" returned: 0 in 0.249s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-quobyte-ce4285bd-2256-4913-b5ba-b8c9935c98d7" released by "delete_volume" :: held 1.358s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Created reservations ['fdc15777-311c-47d0-a081-e212870ef7ea', '9037730f-0a08-4c7e-ba85-3bcc133c858e', 'a471963a-d0ab-4c02-aa9a-08790b89c37b', 'cb33b068-44d8-4b99-a7b3-15c5f14019d8'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.264s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:18 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:24:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Deleted volume successfully.
Sep 23 15:24:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0efcb4be-de49-4808-8088-3d3208ce6e9f tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-ce4285bd-2256-4913-b5ba-b8c9935c98d7-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Flow 'volume_create_manager' (bf84b541-088d-446a-849c-db10cd3b5d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c87c0-89c4-434f-8638-9cb5c64cffe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c87c0-89c4-434f-8638-9cb5c64cffe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2127034539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93cd090-d264-49cd-a0eb-7cae0e4a73f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d94c40eafc45a5a3334c0d86083d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:20Z,use_quota=True,user_id='929fd026d01f4c61a72f3a7b5723a00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efe21ee-83fb-424d-85cd-d3b7ff5b7ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1efe21ee-83fb-424d-85cd-d3b7ff5b7ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f5944-8a9f-4640-a5d9-c4755aaa5858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f5944-8a9f-4640-a5d9-c4755aaa5858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93cd090-d264-49cd-a0eb-7cae0e4a73f2', 'volume_name': 'volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b93002-caa5-42e0-ab4e-926c74723dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b93002-caa5-42e0-ab4e-926c74723dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d60c8ff-730f-4596-92d9-42c7aa15dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:20 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Volume a93cd090-d264-49cd-a0eb-7cae0e4a73f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2', 'volume_size': 1}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2127034539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93cd090-d264-49cd-a0eb-7cae0e4a73f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d94c40eafc45a5a3334c0d86083d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:20Z,use_quota=True,user_id='929fd026d01f4c61a72f3a7b5723a00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Creating volume a93cd090-d264-49cd-a0eb-7cae0e4a73f2 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:24:20 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:24:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:20 devstack quobyte-client[84024]: System call of process 95995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:20 devstack quobyte-client[84024]: System call of process 95995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:20 devstack quobyte-client[84024]: System call of process 95995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:20 devstack quobyte-client[84024]: System call of process 95995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:20 devstack quobyte-client[84024]: System call of process 95995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:20 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=92, name=volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:24:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2 1073741824" returned: 0 in 0.547s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2" returned: 0 in 0.325s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:24:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d60c8ff-730f-4596-92d9-42c7aa15dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04705f5-3cde-4cdd-b666-0bae56e40065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:22 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Volume volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2 (a93cd090-d264-49cd-a0eb-7cae0e4a73f2): created successfully
Sep 23 15:24:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04705f5-3cde-4cdd-b666-0bae56e40065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Flow 'volume_create_manager' (bf84b541-088d-446a-849c-db10cd3b5d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1cd8936c-a280-45ef-830a-6bda328f0a87 tempest-VolumesTransfersV357Test-1041198883 None] Created volume successfully.
Sep 23 15:24:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Acquiring lock "cinder-a93cd090-d264-49cd-a0eb-7cae0e4a73f2-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:24:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-a93cd090-d264-49cd-a0eb-7cae0e4a73f2-delete_volume" acquired by "delete_volume" :: waited 0.261s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:24:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Acquiring lock "cinder-quobyte-a93cd090-d264-49cd-a0eb-7cae0e4a73f2" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:24:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-quobyte-a93cd090-d264-49cd-a0eb-7cae0e4a73f2" acquired by "delete_volume" :: waited 0.036s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:24:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f1ee1a-94ae-4b83-bec8-2fce2c4f255f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:24:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:26 devstack quobyte-client[84024]: System call of process 96031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:24:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2" returned: 0 in 0.662s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a93cd090-d264-49cd-a0eb-7cae0e4a73f2" returned: 0 in 0.113s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-quobyte-a93cd090-d264-49cd-a0eb-7cae0e4a73f2" released by "delete_volume" :: held 1.128s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:26 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Created reservations ['47052045-70be-4013-9960-a7025599353e', '768622a8-986e-4f05-9ba2-fb66f3d4d51b', '2023983c-d238-45a6-bdf6-a3ff3217d688', 'ea52acae-432b-480f-9800-4c7c9b452523'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.110s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:24:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Deleted volume successfully.
Sep 23 15:24:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-47e3d141-0278-475b-8f70-5080ae7aa8d8 tempest-VolumesTransfersV357Test-101996673 None] Lock "cinder-a93cd090-d264-49cd-a0eb-7cae0e4a73f2-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:33 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:33 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Flow 'volume_create_manager' (53f5af29-93f5-4cf0-97d7-e4f7525dc180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da0e477-514d-401b-b4ea-c0c3fabcde18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da0e477-514d-401b-b4ea-c0c3fabcde18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1555244798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae04682-8b1a-4cc3-9ab3-f43785b6be71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e35635f4314e0c9882872c54836b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:33Z,use_quota=True,user_id='829613efddd843ddbfca9d0c2c24dd8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d88b87a-8210-4ab1-af75-ade02acba3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d88b87a-8210-4ab1-af75-ade02acba3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb82c7-2e50-44ce-a7e1-621553ec6e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb82c7-2e50-44ce-a7e1-621553ec6e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae04682-8b1a-4cc3-9ab3-f43785b6be71', 'volume_name': 'volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d38225-07e3-4093-844d-102aedf7eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d38225-07e3-4093-844d-102aedf7eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d61cc3-4704-4ee9-baa2-2722905f99e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:34 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Volume 4ae04682-8b1a-4cc3-9ab3-f43785b6be71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71', 'volume_size': 1}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1555244798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae04682-8b1a-4cc3-9ab3-f43785b6be71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e35635f4314e0c9882872c54836b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:33Z,use_quota=True,user_id='829613efddd843ddbfca9d0c2c24dd8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Creating volume 4ae04682-8b1a-4cc3-9ab3-f43785b6be71 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:24:34 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:24:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:35 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=93, name=volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:24:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71 1073741824" returned: 0 in 1.144s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71" returned: 0 in 0.491s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] <== create_volume: return (1989ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:24:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:36 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=30,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=9 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:24:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d61cc3-4704-4ee9-baa2-2722905f99e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066daa4a-f4bb-4900-9a17-80a200c67e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:37 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Volume volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71 (4ae04682-8b1a-4cc3-9ab3-f43785b6be71): created successfully
Sep 23 15:24:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066daa4a-f4bb-4900-9a17-80a200c67e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Flow 'volume_create_manager' (53f5af29-93f5-4cf0-97d7-e4f7525dc180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:37 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-1127133a-900d-4a2f-a0ca-4a7fc083528f tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Created volume successfully.
Sep 23 15:24:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Acquiring lock "cinder-4ae04682-8b1a-4cc3-9ab3-f43785b6be71-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:24:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "cinder-4ae04682-8b1a-4cc3-9ab3-f43785b6be71-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:24:41 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Acquiring lock "cinder-quobyte-4ae04682-8b1a-4cc3-9ab3-f43785b6be71" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:24:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "cinder-quobyte-4ae04682-8b1a-4cc3-9ab3-f43785b6be71" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:24:41 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3886726-c5e8-46fe-b032-13b32be137ea]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:24:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71" returned: 0 in 0.846s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4ae04682-8b1a-4cc3-9ab3-f43785b6be71" returned: 0 in 0.260s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "cinder-quobyte-4ae04682-8b1a-4cc3-9ab3-f43785b6be71" released by "delete_volume" :: held 1.510s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Created reservations ['bf05ac29-cff0-4fd2-841b-cae105416381', '1279855f-9393-4bec-97b5-0da517e373ad', 'a29a417b-4f84-4d57-97bf-f9f028cf736f', '14f8a5bc-01bc-4c58-a0f7-9a197ce4ee05'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.241s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:43 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:24:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Deleted volume successfully.
Sep 23 15:24:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5b372e03-f2e4-4cec-a5ef-933aa7a35747 tempest-VolumeQuotasNegativeTestJSON-1774608992 None] Lock "cinder-4ae04682-8b1a-4cc3-9ab3-f43785b6be71-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:24:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Flow 'volume_create_manager' (8fcdb285-26f6-4f12-ac6d-fcca1009a537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d7a6d5-361b-46c1-a5b9-4fb4db5fd5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=68,cinder:SELECT=38,cinder:INSERT=11,cinder:DELETE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d7a6d5-361b-46c1-a5b9-4fb4db5fd5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1069576800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f458ee8f-2041-411b-b81a-4848d49444ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fa5917c71c42c68e9c357da081e8a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:47Z,use_quota=True,user_id='bd70bd8e71394b76b1b7aaf4a0f4ed57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6719ca2-11d5-40d4-a0a7-a4732d2dc800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6719ca2-11d5-40d4-a0a7-a4732d2dc800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1e1272-9568-4850-9d72-9fda85c2b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1e1272-9568-4850-9d72-9fda85c2b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f458ee8f-2041-411b-b81a-4848d49444ba', 'volume_name': 'volume-f458ee8f-2041-411b-b81a-4848d49444ba', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5034dc4b-d5af-4554-80ab-7f064c7b83b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5034dc4b-d5af-4554-80ab-7f064c7b83b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65713bb9-7e52-48ce-ba8a-2305fb673a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:47 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Volume f458ee8f-2041-411b-b81a-4848d49444ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f458ee8f-2041-411b-b81a-4848d49444ba', 'volume_size': 1}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1069576800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f458ee8f-2041-411b-b81a-4848d49444ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fa5917c71c42c68e9c357da081e8a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:24:47Z,use_quota=True,user_id='bd70bd8e71394b76b1b7aaf4a0f4ed57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Creating volume f458ee8f-2041-411b-b81a-4848d49444ba {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:24:47 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:47 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=94, name=volume-f458ee8f-2041-411b-b81a-4848d49444ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba 1073741824" returned: 0 in 0.478s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba" returned: 0 in 0.162s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65713bb9-7e52-48ce-ba8a-2305fb673a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f458ee8f-2041-411b-b81a-4848d49444ba', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a32dfc-c031-4878-8ea5-a3bb796351ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:24:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Volume volume-f458ee8f-2041-411b-b81a-4848d49444ba (f458ee8f-2041-411b-b81a-4848d49444ba): created successfully
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a32dfc-c031-4878-8ea5-a3bb796351ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:24:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Flow 'volume_create_manager' (8fcdb285-26f6-4f12-ac6d-fcca1009a537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:24:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d11822c1-02be-4049-85a6-ef0106bfbb2f tempest-VolumesNegativeTest-1615258702 None] Created volume successfully.
Sep 23 15:24:58 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:24:58 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.168s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:25:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Flow 'volume_create_manager' (698dad77-19ca-42d1-a4bd-a21592fae7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87627b7-7409-4c79-b830-5d730b6ede8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87627b7-7409-4c79-b830-5d730b6ede8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-941308174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717254cd-594d-4a31-b3bb-b4a48280c2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae0752bd93fc41c690aabbed86b519d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:25:18Z,use_quota=True,user_id='d1e491bd9d0746d4ba48c4c3c1d3b21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3aa4f08-8c12-4fbe-bd4a-840b1c03853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3aa4f08-8c12-4fbe-bd4a-840b1c03853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7794835b-294e-44d6-8976-77bc96cd860b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7794835b-294e-44d6-8976-77bc96cd860b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717254cd-594d-4a31-b3bb-b4a48280c2ff', 'volume_name': 'volume-717254cd-594d-4a31-b3bb-b4a48280c2ff', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dca95b9-55d9-4739-8a79-b0edb774abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dca95b9-55d9-4739-8a79-b0edb774abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9c5bc-2e66-402d-8a3d-46a4cb2cd457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Volume 717254cd-594d-4a31-b3bb-b4a48280c2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717254cd-594d-4a31-b3bb-b4a48280c2ff', 'volume_size': 1}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-941308174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717254cd-594d-4a31-b3bb-b4a48280c2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae0752bd93fc41c690aabbed86b519d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:25:18Z,use_quota=True,user_id='d1e491bd9d0746d4ba48c4c3c1d3b21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Creating volume 717254cd-594d-4a31-b3bb-b4a48280c2ff {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:25:18 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:25:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:18 devstack quobyte-client[84024]: System call of process 96531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:18 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=95, name=volume-717254cd-594d-4a31-b3bb-b4a48280c2ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff 1073741824" returned: 0 in 0.526s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff" returned: 0 in 0.112s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] <== create_volume: return (723ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9c5bc-2e66-402d-8a3d-46a4cb2cd457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717254cd-594d-4a31-b3bb-b4a48280c2ff', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651011b7-5bae-4e6d-8c33-57528d176a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:19 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Volume volume-717254cd-594d-4a31-b3bb-b4a48280c2ff (717254cd-594d-4a31-b3bb-b4a48280c2ff): created successfully
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651011b7-5bae-4e6d-8c33-57528d176a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Flow 'volume_create_manager' (698dad77-19ca-42d1-a4bd-a21592fae7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:25:19 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-61975000-3b01-48eb-adb8-e1fe02a69bfa tempest-AbsoluteLimitsTests-557306189 None] Created volume successfully.
Sep 23 15:25:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Acquiring lock "cinder-717254cd-594d-4a31-b3bb-b4a48280c2ff-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Lock "cinder-717254cd-594d-4a31-b3bb-b4a48280c2ff-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Acquiring lock "cinder-quobyte-717254cd-594d-4a31-b3bb-b4a48280c2ff" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Lock "cinder-quobyte-717254cd-594d-4a31-b3bb-b4a48280c2ff" acquired by "delete_volume" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:20 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501e83f-adb9-4661-be0c-6ff4716ea64e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:21 devstack quobyte-client[84024]: System call of process 96535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff" returned: 0 in 0.481s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-717254cd-594d-4a31-b3bb-b4a48280c2ff" returned: 0 in 0.108s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Lock "cinder-quobyte-717254cd-594d-4a31-b3bb-b4a48280c2ff" released by "delete_volume" :: held 0.785s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:21 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Created reservations ['8dd79736-a279-43c4-b1b8-5b8c929b572b', '5b60304d-68af-44ad-a77f-28d6c2d46cd0', '63b683b5-3aa2-4e3a-8064-275be43ff6bf', '9ef76c82-0946-4f2c-b77c-46a76c1a03ba'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.149s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:25:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Deleted volume successfully.
Sep 23 15:25:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b93bddec-9949-49f1-8014-1b44d18508e5 tempest-AbsoluteLimitsTests-557306189 None] Lock "cinder-717254cd-594d-4a31-b3bb-b4a48280c2ff-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:31 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Flow 'volume_create_manager' (c32ddeca-7746-4ccb-a999-0671a8419694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc64891-fec7-48e5-a189-3c565e2d214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc64891-fec7-48e5-a189-3c565e2d214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2092653980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7c0571-ea3f-4da5-b2bd-e5e3bda55610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c98255f47ac44f0bc6f8f46b53d40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:25:32Z,use_quota=True,user_id='23426a5b33d94d4d9254f1151fa9b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e122e2-906c-4532-a75b-81fa611890d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e122e2-906c-4532-a75b-81fa611890d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad584f0-cc6c-4a4e-8a39-a696884e9056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad584f0-cc6c-4a4e-8a39-a696884e9056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7c0571-ea3f-4da5-b2bd-e5e3bda55610', 'volume_name': 'volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b5e7f2-14cf-444a-974a-278c6d5913c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b5e7f2-14cf-444a-974a-278c6d5913c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83808e2-4c98-4775-ad14-3ede0e9274bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:32 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Volume 1d7c0571-ea3f-4da5-b2bd-e5e3bda55610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610', 'volume_size': 1}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2092653980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7c0571-ea3f-4da5-b2bd-e5e3bda55610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c98255f47ac44f0bc6f8f46b53d40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:25:32Z,use_quota=True,user_id='23426a5b33d94d4d9254f1151fa9b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Creating volume 1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:25:32 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:32 devstack quobyte-client[84024]: System call of process 96668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:32 devstack quobyte-client[84024]: System call of process 96668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:32 devstack quobyte-client[84024]: System call of process 96668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:32 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=96, name=volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 1073741824" returned: 0 in 0.400s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.117s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:25:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.616s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83808e2-4c98-4775-ad14-3ede0e9274bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dbef8a-2764-4a7d-8ab4-e1e0984ba562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:33 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Volume volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 (1d7c0571-ea3f-4da5-b2bd-e5e3bda55610): created successfully
Sep 23 15:25:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dbef8a-2764-4a7d-8ab4-e1e0984ba562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Flow 'volume_create_manager' (c32ddeca-7746-4ccb-a999-0671a8419694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:25:33 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-58985b02-503e-4107-8532-27f27e7d980c tempest-VolumesDeleteCascade-790847931 None] Created volume successfully.
Sep 23 15:25:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Creating offline snapshot cb5cb0e3-8acc-4815-a08e-7f83829e8c5b of volume 1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:25:34 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30de9c2-46d1-44ec-a05d-f1fc259e488e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.858s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:35 devstack quobyte-client[84024]: System call of process 96685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:35 devstack quobyte-client[84024]: System call of process 96685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:35 devstack quobyte-client[84024]: System call of process 96685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:35 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=97, name=volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:25:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b 1G" returned: 0 in 0.409s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:36 devstack quobyte-client[84024]: System call of process 96692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:36 devstack quobyte-client[84024]: System call of process 96692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:36 devstack quobyte-client[84024]: System call of process 96692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:36 devstack quobyte-client[84024]: System call of process 96692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img rebase -u -b volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.437s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:25:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.280s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:25:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.358s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.info" returned: 0 in 0.198s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.info" returned: 0 in 0.165s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.519s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:38 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e8092bc1-494a-4d7f-8cd1-5f0d2f2b148b tempest-VolumesDeleteCascade-790847931 None] Create snapshot completed successfully
Sep 23 15:25:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Creating offline snapshot df3706cd-e8f5-49c0-aa66-6bdab3764282 of volume 1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:25:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f03ca2-0211-47d3-8b92-c1476fae028f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:39 devstack quobyte-client[84024]: System call of process 96703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:39 devstack quobyte-client[84024]: System call of process 96703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:39 devstack quobyte-client[84024]: System call of process 96703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.696s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:40 devstack quobyte-client[84024]: System call of process 96706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:40 devstack quobyte-client[84024]: System call of process 96706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:40 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=99, name=volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 1G" returned: 0 in 0.491s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:40 devstack quobyte-client[84024]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:40 devstack quobyte-client[84024]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:40 devstack quobyte-client[84024]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:40 devstack quobyte-client[84024]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img rebase -u -b volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.247s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:25:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.130s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:25:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.199s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4add145b-e4e9-435d-a970-ecd016554137 tempest-VolumesDeleteCascade-790847931 None] Create snapshot completed successfully
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:43 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Performing cascade delete. {{(pid=84009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Acquiring lock "cinder-f458ee8f-2041-411b-b81a-4848d49444ba-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-cb5cb0e3-8acc-4815-a08e-7f83829e8c5b-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Lock "cinder-f458ee8f-2041-411b-b81a-4848d49444ba-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-cb5cb0e3-8acc-4815-a08e-7f83829e8c5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:43 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:43 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Acquiring lock "cinder-quobyte-f458ee8f-2041-411b-b81a-4848d49444ba" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Lock "cinder-quobyte-f458ee8f-2041-411b-b81a-4848d49444ba" acquired by "delete_volume" :: waited 0.036s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Deleting offline snapshot cb5cb0e3-8acc-4815-a08e-7f83829e8c5b of volume 1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] snapshot_file for this snap is: volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[210718e9-d3a3-404d-b30c-0012c59e6999]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67412f-f252-4445-b9d7-b9704e8ade6f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba" returned: 0 in 0.576s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:44 devstack quobyte-client[84024]: System call of process 96715 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.637s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f8c5ca-a6f9-41d4-806a-ac791d01ff0f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f458ee8f-2041-411b-b81a-4848d49444ba" returned: 0 in 0.292s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Lock "cinder-quobyte-f458ee8f-2041-411b-b81a-4848d49444ba" released by "delete_volume" :: held 1.171s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:45 devstack quobyte-client[84024]: System call of process 96721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:45 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Created reservations ['a5ec0864-82d7-40db-9459-10b303c4e59f', '5a009c6c-4e18-475d-b401-e7816ac49d56', '3ca1d6a0-0301-47bc-ae9b-a9f9948f856a', 'c9f2ec05-3367-4021-9370-94c2c0da1868'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:25:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.701s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddf3bfe-c853-49ef-9f61-b1d5de9f987a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.205s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:25:46 devstack quobyte-client[84024]: System call of process 96728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Deleted volume successfully.
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.969s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73be609-43fb-4472-96b5-ac24decb8dbe]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0af210e7-8d3a-4041-ad71-043c973b8455 tempest-VolumesNegativeTest-1615258702 None] Lock "cinder-f458ee8f-2041-411b-b81a-4848d49444ba-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:47 devstack quobyte-client[84024]: System call of process 96733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:47 devstack quobyte-client[84024]: System call of process 96733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:47 devstack quobyte-client[84024]: System call of process 96733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.727s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:25:47 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[77944155-9cee-445f-94bf-c2ad52ab2748]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:48 devstack quobyte-client[84024]: System call of process 96740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.533s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:48 devstack quobyte-client[84024]: System call of process 96743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:48 devstack quobyte-client[84024]: System call of process 96743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:48 devstack quobyte-client[84024]: System call of process 96743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.443s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" returned: 0 in 0.159s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 -F qcow2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:49 devstack quobyte-client[84024]: System call of process 96747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img rebase -u -b volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 -F qcow2" returned: 0 in 0.233s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-cb5cb0e3-8acc-4815-a08e-7f83829e8c5b" released by "_delete_snapshot" :: held 5.279s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" released by "delete_snapshot" :: held 5.351s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:49 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Created reservations ['299279c6-2546-45e4-8a3f-ce2a37003a6d', 'f1f3012d-0751-449d-aa47-6193912d9390', 'f35cd83e-45e3-47a0-bc67-9675b803590f', '94cce0bb-45a9-4112-885c-4564dacbd817'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:25:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Delete snapshot completed successfully.
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-cb5cb0e3-8acc-4815-a08e-7f83829e8c5b-delete_snapshot" released by "delete_snapshot" :: held 6.246s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-df3706cd-e8f5-49c0-aa66-6bdab3764282-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-df3706cd-e8f5-49c0-aa66-6bdab3764282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:50 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-df3706cd-e8f5-49c0-aa66-6bdab3764282" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-df3706cd-e8f5-49c0-aa66-6bdab3764282" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Deleting offline snapshot df3706cd-e8f5-49c0-aa66-6bdab3764282 of volume 1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] snapshot_file for this snap is: volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba450fd-37b9-457a-a69a-797c4d8c9f3c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:51 devstack quobyte-client[84024]: System call of process 96751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.772s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:25:51 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5abb13-ba92-4b39-9b47-420d2b60b06c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:51 devstack quobyte-client[84024]: System call of process 96755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.634s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:52 devstack quobyte-client[84024]: System call of process 96758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.403s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610.df3706cd-e8f5-49c0-aa66-6bdab3764282" returned: 0 in 0.152s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-df3706cd-e8f5-49c0-aa66-6bdab3764282" released by "_delete_snapshot" :: held 2.560s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" released by "delete_snapshot" :: held 2.628s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Created reservations ['4ff2a44f-1351-4ea4-a8f9-b23855873a7e', 'd53fb793-e0e3-4fac-b59e-5dd27d4d82f7', '17345a5b-bf8e-4e19-bc44-b035089a428d', 'ffb36c76-be55-4d49-b8b9-05c87cea9f7f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:25:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Delete snapshot completed successfully.
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-df3706cd-e8f5-49c0-aa66-6bdab3764282-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Snapshots deleted, issuing volume delete {{(pid=84009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" acquired by "delete_volume" :: waited 0.029s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b1d927-51c3-45e5-8197-9f5b3fe794fb]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:54 devstack quobyte-client[84024]: System call of process 96765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.577s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" returned: 0 in 0.118s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610" released by "delete_volume" :: held 0.996s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Created reservations ['f53987f8-df08-428c-bba1-50e56f8eb8a2', 'b91c3cf5-52be-48b0-889a-9caf63aeee1c', 'd259d159-f65f-498a-8279-7869c803fd62', '30776292-a2a2-4aee-8045-280bac48942c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.108s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:25:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Deleted volume successfully.
Sep 23 15:25:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-52ed63b9-3664-494c-8f69-36902a1f07fe tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-1d7c0571-ea3f-4da5-b2bd-e5e3bda55610-delete_volume" released by "delete_volume" :: held 12.025s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:25:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Flow 'volume_create_manager' (9fe91354-183d-464d-8912-f4bd0b993af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a945b4-03c2-4250-ae3a-a25aaf2c84d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a945b4-03c2-4250-ae3a-a25aaf2c84d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2048836872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75db23a9-7fc4-4d56-a361-e592f9d349af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c98255f47ac44f0bc6f8f46b53d40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:25:57Z,use_quota=True,user_id='23426a5b33d94d4d9254f1151fa9b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4efdd0-87e7-4433-a2c7-f47b06a5182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4efdd0-87e7-4433-a2c7-f47b06a5182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83b10f5-dcbe-4bed-9bf1-3175ff590875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83b10f5-dcbe-4bed-9bf1-3175ff590875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75db23a9-7fc4-4d56-a361-e592f9d349af', 'volume_name': 'volume-75db23a9-7fc4-4d56-a361-e592f9d349af', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d9b6ec-6317-4bdc-b7a9-7dc4e815ae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d9b6ec-6317-4bdc-b7a9-7dc4e815ae00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731c5971-aeda-4d3e-b2c7-f7a5cd9e3122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:56 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Volume 75db23a9-7fc4-4d56-a361-e592f9d349af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75db23a9-7fc4-4d56-a361-e592f9d349af', 'volume_size': 1}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2048836872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75db23a9-7fc4-4d56-a361-e592f9d349af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c98255f47ac44f0bc6f8f46b53d40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:25:57Z,use_quota=True,user_id='23426a5b33d94d4d9254f1151fa9b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Creating volume 75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:25:56 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:25:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:57 devstack quobyte-client[84024]: System call of process 96772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:57 devstack quobyte-client[84024]: System call of process 96772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:25:57 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=100, name=volume-75db23a9-7fc4-4d56-a361-e592f9d349af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:25:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af 1073741824" returned: 0 in 0.600s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:25:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.166s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:25:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] <== create_volume: return (883ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:25:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:25:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731c5971-aeda-4d3e-b2c7-f7a5cd9e3122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75db23a9-7fc4-4d56-a361-e592f9d349af', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0ff70a-539b-414c-9cfc-ef15851a7676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:25:58 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Volume volume-75db23a9-7fc4-4d56-a361-e592f9d349af (75db23a9-7fc4-4d56-a361-e592f9d349af): created successfully
Sep 23 15:25:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0ff70a-539b-414c-9cfc-ef15851a7676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:25:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Flow 'volume_create_manager' (9fe91354-183d-464d-8912-f4bd0b993af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:25:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-dcf8f36c-3fd4-4684-8d85-32d54c2b5e33 tempest-VolumesDeleteCascade-790847931 None] Created volume successfully.
Sep 23 15:25:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:25:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:25:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:25:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Creating offline snapshot 5c7963be-1699-4d66-adf2-1bef2a79328a of volume 75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:25:59 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670eb5f-7e4b-4a50-b992-8dadff6c6f49]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:25:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.680s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:00 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=101, name=volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a 1G" returned: 0 in 0.335s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img rebase -u -b volume-75db23a9-7fc4-4d56-a361-e592f9d349af -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:00 devstack quobyte-client[84024]: System call of process 96782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img rebase -u -b volume-75db23a9-7fc4-4d56-a361-e592f9d349af -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 0.279s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 0.115s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:26:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 0.144s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.info" returned: 0 in 0.148s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.info" returned: 0 in 0.183s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:02 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-239ee834-1454-46bf-91a3-58c3db2a01e9 tempest-VolumesDeleteCascade-790847931 None] Create snapshot completed successfully
Sep 23 15:26:03 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Flow 'volume_create_manager' (4ec522f7-1cf0-42f9-850f-345633b72395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f502717-2173-47be-8669-5f95e20c193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f502717-2173-47be-8669-5f95e20c193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-66625078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c64e56-fbb0-4922-9707-75666ffba724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c98255f47ac44f0bc6f8f46b53d40be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c7963be-1699-4d66-adf2-1bef2a79328a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:03Z,use_quota=True,user_id='23426a5b33d94d4d9254f1151fa9b28a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc88f61-737e-48dd-b830-fb8f9a6f274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc88f61-737e-48dd-b830-fb8f9a6f274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5a13a9-3946-4a6f-9f88-e3e8e9743a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5a13a9-3946-4a6f-9f88-e3e8e9743a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73c64e56-fbb0-4922-9707-75666ffba724', 'volume_name': 'volume-73c64e56-fbb0-4922-9707-75666ffba724', 'volume_size': 1, 'snapshot_id': '5c7963be-1699-4d66-adf2-1bef2a79328a'}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36e4b62-c515-4a26-a7b9-3fcbf316ca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36e4b62-c515-4a26-a7b9-3fcbf316ca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab528b1-b5d1-43e3-8a96-06d9c03857c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:03 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Volume 73c64e56-fbb0-4922-9707-75666ffba724: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73c64e56-fbb0-4922-9707-75666ffba724', 'volume_size': 1, 'snapshot_id': '5c7963be-1699-4d66-adf2-1bef2a79328a'}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-5c7963be-1699-4d66-adf2-1bef2a79328a-73c64e56-fbb0-4922-9707-75666ffba724" by "_create_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-5c7963be-1699-4d66-adf2-1bef2a79328a-73c64e56-fbb0-4922-9707-75666ffba724" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Creating volume 73c64e56-fbb0-4922-9707-75666ffba724 from snapshot 5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-73c64e56-fbb0-4922-9707-75666ffba724" by "_copy_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-73c64e56-fbb0-4922-9707-75666ffba724" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] snapshot: 5c7963be-1699-4d66-adf2-1bef2a79328a, volume: 73c64e56-fbb0-4922-9707-75666ffba724,  {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee700835-6e30-44d3-95b8-266b3b180678]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 0.512s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75db23a9-7fc4-4d56-a361-e592f9d349af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Creating direct copy from snapshot {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[374aa0fe-4151-4fff-847d-e2c3fa16cfe4]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.437s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG cinder.utils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 not found in is_blk_device check {{(pid=84009) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 23 15:26:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:04 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=103, name=volume-73c64e56-fbb0-4922-9707-75666ffba724, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.455s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:26:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724" returned: 0 in 6.206s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:10 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce862bc-57ae-40e1-bd45-dac29d15c2f3]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.580s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Image conversion details: src /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:26:11 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Converted 1024.00 MB image at 164.58 MB/s
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724" returned: 0 in 0.109s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-73c64e56-fbb0-4922-9707-75666ffba724" released by "_copy_volume_from_snapshot" :: held 8.300s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-5c7963be-1699-4d66-adf2-1bef2a79328a-73c64e56-fbb0-4922-9707-75666ffba724" released by "_create_volume_from_snapshot" :: held 8.334s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.353s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:11 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=32,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:26:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab528b1-b5d1-43e3-8a96-06d9c03857c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c64e56-fbb0-4922-9707-75666ffba724', 'volume_size': 1, 'snapshot_id': '5c7963be-1699-4d66-adf2-1bef2a79328a'}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c842fe9f-ec0c-4a24-bf86-56c0aee48d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Volume volume-73c64e56-fbb0-4922-9707-75666ffba724 (73c64e56-fbb0-4922-9707-75666ffba724): created successfully
Sep 23 15:26:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c842fe9f-ec0c-4a24-bf86-56c0aee48d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Flow 'volume_create_manager' (4ec522f7-1cf0-42f9-850f-345633b72395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6e1b119f-224b-40b7-ac96-aa817af333cd tempest-VolumesDeleteCascade-790847931 None] Created volume successfully.
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-75db23a9-7fc4-4d56-a361-e592f9d349af-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-75db23a9-7fc4-4d56-a361-e592f9d349af-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Performing cascade delete. {{(pid=84009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-5c7963be-1699-4d66-adf2-1bef2a79328a-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-5c7963be-1699-4d66-adf2-1bef2a79328a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-75db23a9-7fc4-4d56-a361-e592f9d349af" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-75db23a9-7fc4-4d56-a361-e592f9d349af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-5c7963be-1699-4d66-adf2-1bef2a79328a" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-5c7963be-1699-4d66-adf2-1bef2a79328a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Deleting offline snapshot 5c7963be-1699-4d66-adf2-1bef2a79328a of volume 75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] snapshot_file for this snap is: volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74690e33-04fe-4953-b016-55b3eed60a70]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:14 devstack quobyte-client[84024]: System call of process 96824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-cd2888cb-d7fe-4074-9087-fd97f0ad0726 req-143cb886-e9bf-4214-aa02-fda8bbca5772 tempest-TestMinimumBasicScenario-48379546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 1.579s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75db23a9-7fc4-4d56-a361-e592f9d349af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:26:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-cd2888cb-d7fe-4074-9087-fd97f0ad0726 req-143cb886-e9bf-4214-aa02-fda8bbca5772 tempest-TestMinimumBasicScenario-48379546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-cd2888cb-d7fe-4074-9087-fd97f0ad0726 req-143cb886-e9bf-4214-aa02-fda8bbca5772 tempest-TestMinimumBasicScenario-48379546 None] Terminate volume connection completed successfully.
Sep 23 15:26:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-cd2888cb-d7fe-4074-9087-fd97f0ad0726 req-143cb886-e9bf-4214-aa02-fda8bbca5772 tempest-TestMinimumBasicScenario-48379546 None] Deleting attachment 8409f2c6-4312-458f-ab5f-fabb4d7a26da. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:26:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d1837d-55b5-48a5-b94c-8e4336942643]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:16 devstack quobyte-client[84024]: System call of process 96829 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.916s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:16 devstack quobyte-client[84024]: System call of process 96832 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 0.445s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Acquiring lock "cinder-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af.5c7963be-1699-4d66-adf2-1bef2a79328a" returned: 0 in 0.449s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Lock "cinder-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-5c7963be-1699-4d66-adf2-1bef2a79328a" released by "_delete_snapshot" :: held 4.001s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-75db23a9-7fc4-4d56-a361-e592f9d349af" released by "delete_snapshot" :: held 4.041s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Acquiring lock "cinder-quobyte-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Lock "cinder-quobyte-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" acquired by "delete_volume" :: waited 0.111s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1658e-2a89-4531-9742-bb81e7c28b63]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Created reservations ['49415e8b-a7a8-450b-a9cd-383043de88a3', '386a3a9b-a0c9-4531-a1ce-ca71fa9acdc3', '24d16347-da57-4bcc-bc12-bca38916ea95', '463eb21f-d2b7-42f4-a020-de3d39e4525f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=48,cinder:UPDATE=57,cinder:INSERT=11,cinder:DELETE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:26:18 devstack quobyte-client[84024]: System call of process 96837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:18 devstack quobyte-client[84024]: System call of process 96837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:18 devstack quobyte-client[84024]: System call of process 96837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Delete snapshot completed successfully.
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-5c7963be-1699-4d66-adf2-1bef2a79328a-delete_snapshot" released by "delete_snapshot" :: held 5.421s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Snapshots deleted, issuing volume delete {{(pid=84009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-75db23a9-7fc4-4d56-a361-e592f9d349af" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" returned: 0 in 0.984s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-75db23a9-7fc4-4d56-a361-e592f9d349af" acquired by "delete_volume" :: waited 0.397s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" returned: 0 in 0.468s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a636fb02-f2ff-40c2-a475-e416b2eb1c47]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Lock "cinder-quobyte-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676" released by "delete_volume" :: held 1.732s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:20 devstack quobyte-client[84024]: System call of process 96842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:20 devstack quobyte-client[84024]: System call of process 96842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.760s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-75db23a9-7fc4-4d56-a361-e592f9d349af" returned: 0 in 0.334s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Created reservations ['d1245ea7-5b28-42a5-a5f4-8d2db99f9826', 'dcc494db-ff30-4da8-aed2-cf8e9c2ecd04', 'ac77dee1-5004-44f5-b38b-3f2f5ccf8502', '92629a4e-ece1-48a0-8414-2f4e636fd31c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-75db23a9-7fc4-4d56-a361-e592f9d349af" released by "delete_volume" :: held 1.470s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.228s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:26:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Deleted volume successfully.
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Created reservations ['5482777f-a682-4304-b6ac-d4587180ef08', 'dddb8ef4-ffe7-4d0a-b1f3-8afc7c9505cf', '8ed6b231-efef-4d8f-95ba-6a77e960a141', '1a022800-1a23-47e5-82ef-e5bdc9233e30'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6b7360f-487f-4b86-8577-adf684aaf7b8 tempest-TestMinimumBasicScenario-48379546 None] Lock "cinder-df8e5bc1-3be2-4ee9-ace3-64c8e2c4b676-delete_volume" released by "delete_volume" :: held 4.127s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.137s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:21 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:26:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Deleted volume successfully.
Sep 23 15:26:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9211f11d-132f-4b2a-8f4f-901c889cb1b8 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-75db23a9-7fc4-4d56-a361-e592f9d349af-delete_volume" released by "delete_volume" :: held 8.908s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-73c64e56-fbb0-4922-9707-75666ffba724-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-73c64e56-fbb0-4922-9707-75666ffba724-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "cinder-quobyte-73c64e56-fbb0-4922-9707-75666ffba724" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:26:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-73c64e56-fbb0-4922-9707-75666ffba724" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:26:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed2c8e-b20c-4cc8-ba34-7ed4387d52e8]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:24 devstack quobyte-client[84024]: System call of process 96852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724" returned: 0 in 1.444s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-73c64e56-fbb0-4922-9707-75666ffba724" returned: 0 in 0.107s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-quobyte-73c64e56-fbb0-4922-9707-75666ffba724" released by "delete_volume" :: held 1.748s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Flow 'volume_create_manager' (1ea364a1-c800-44a5-ad7a-15af0030a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdca766a-5bb9-4e55-b713-0e425d95658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdca766a-5bb9-4e55-b713-0e425d95658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-617634791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57703639-cb6e-4315-b1c0-4488964862a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7f0f1878614684af2940ec3fb9d3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:25Z,use_quota=True,user_id='49f2a5e67cbd486a9ebb9388e3000068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f7d61e0-26e0-4b6d-936b-8badb7f549e3),volume_type_id=0f7d61e0-26e0-4b6d-936b-8badb7f549e3)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2045a10-954d-4cfa-8e29-cfd419046e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2045a10-954d-4cfa-8e29-cfd419046e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba6094c-79aa-4617-946e-d80159033534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba6094c-79aa-4617-946e-d80159033534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57703639-cb6e-4315-b1c0-4488964862a3', 'volume_name': 'volume-57703639-cb6e-4315-b1c0-4488964862a3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee64c5a-d069-426b-86d0-1efc08a1f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee64c5a-d069-426b-86d0-1efc08a1f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fada61ab-5aa2-47cd-9a02-46271c3116e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:25 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume 57703639-cb6e-4315-b1c0-4488964862a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57703639-cb6e-4315-b1c0-4488964862a3', 'volume_size': 1}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-617634791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57703639-cb6e-4315-b1c0-4488964862a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7f0f1878614684af2940ec3fb9d3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:25Z,use_quota=True,user_id='49f2a5e67cbd486a9ebb9388e3000068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f7d61e0-26e0-4b6d-936b-8badb7f549e3),volume_type_id=0f7d61e0-26e0-4b6d-936b-8badb7f549e3)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Creating volume 57703639-cb6e-4315-b1c0-4488964862a3 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:26:25 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:25 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=104, name=volume-57703639-cb6e-4315-b1c0-4488964862a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Created reservations ['ef003e79-bdb9-4306-9c11-ba6a2efc4b7b', '53b7f85b-01d4-494c-bbf7-caa804796470', 'fedc1230-7d27-419c-872e-7996ee7f774e', 'ddd54d12-fdd5-4835-8d91-fd953a30e40e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:26:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3 1073741824" returned: 0 in 1.260s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:27 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:26:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Flow 'volume_create_manager' (abe996f2-14ec-4a8f-8435-34ac8cd0bb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0228336c-49e4-4369-8eb6-eaed827f2fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0228336c-49e4-4369-8eb6-eaed827f2fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-189604564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cfd592-93e1-4e57-9a3c-59b766cf4f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7f0f1878614684af2940ec3fb9d3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:26Z,use_quota=True,user_id='49f2a5e67cbd486a9ebb9388e3000068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a7367a5-caf1-43dd-8213-137e0f8699f4),volume_type_id=8a7367a5-caf1-43dd-8213-137e0f8699f4)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8cb9d9-87cb-4e88-8624-60896e21fb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8cb9d9-87cb-4e88-8624-60896e21fb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d7e7c0-868f-4651-acd7-9b91abf8c213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d7e7c0-868f-4651-acd7-9b91abf8c213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56cfd592-93e1-4e57-9a3c-59b766cf4f21', 'volume_name': 'volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ce1f27-1f0e-478c-ba59-fac242c817ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ce1f27-1f0e-478c-ba59-fac242c817ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de1541c-d8f8-4ebc-a47e-f6ea45c952fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:28 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume 56cfd592-93e1-4e57-9a3c-59b766cf4f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21', 'volume_size': 1}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3" returned: 0 in 1.410s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] <== create_volume: return (2721ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-189604564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cfd592-93e1-4e57-9a3c-59b766cf4f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7f0f1878614684af2940ec3fb9d3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:26Z,use_quota=True,user_id='49f2a5e67cbd486a9ebb9388e3000068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a7367a5-caf1-43dd-8213-137e0f8699f4),volume_type_id=8a7367a5-caf1-43dd-8213-137e0f8699f4)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Creating volume 56cfd592-93e1-4e57-9a3c-59b766cf4f21 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:26:29 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:29 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=105, name=volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fada61ab-5aa2-47cd-9a02-46271c3116e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57703639-cb6e-4315-b1c0-4488964862a3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8812cd-8b12-49cd-9be5-6b8dedcb59ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:29 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Flow 'volume_create_manager' (aa803517-2cbe-4739-922a-408e7970a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a5f52d-ebdf-421a-a921-c35b8fcfb646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:29 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume volume-57703639-cb6e-4315-b1c0-4488964862a3 (57703639-cb6e-4315-b1c0-4488964862a3): created successfully
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8812cd-8b12-49cd-9be5-6b8dedcb59ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Flow 'volume_create_manager' (1ea364a1-c800-44a5-ad7a-15af0030a05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 1.408s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 1073741824" returned: 0 in 0.821s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Deleted volume successfully.
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a5f52d-ebdf-421a-a921-c35b8fcfb646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-807335653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a82613-7657-4d51-ace3-742ca137b7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7f0f1878614684af2940ec3fb9d3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:27Z,use_quota=True,user_id='49f2a5e67cbd486a9ebb9388e3000068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3b0bd2-30b0-41c4-9496-0f86b4447101),volume_type_id=2c3b0bd2-30b0-41c4-9496-0f86b4447101)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a40395-b9b1-4eb9-93c2-6a826ec0bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a40395-b9b1-4eb9-93c2-6a826ec0bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c023b96-ee1c-4f75-af39-6cdf04375258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:26:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c3542b65-6d25-4013-9644-5c81b39e7c90 tempest-TestInstancesWithCinderVolumes-1823528635 None] Created volume successfully.
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21" returned: 0 in 0.605s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] <== create_volume: return (1465ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8a829300-8620-48b9-8be6-3f5003c49601 tempest-VolumesDeleteCascade-790847931 None] Lock "cinder-73c64e56-fbb0-4922-9707-75666ffba724-delete_volume" released by "delete_volume" :: held 7.742s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de1541c-d8f8-4ebc-a47e-f6ea45c952fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5ce1d5-a0cd-4cfe-aa53-e8bcaa4be8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:30 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 (56cfd592-93e1-4e57-9a3c-59b766cf4f21): created successfully
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5ce1d5-a0cd-4cfe-aa53-e8bcaa4be8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Flow 'volume_create_manager' (abe996f2-14ec-4a8f-8435-34ac8cd0bb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0106e958-c1bf-42ce-a7b0-56a2c62ba755 tempest-TestInstancesWithCinderVolumes-1823528635 None] Created volume successfully.
Sep 23 15:26:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c023b96-ee1c-4f75-af39-6cdf04375258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2a82613-7657-4d51-ace3-742ca137b7ee', 'volume_name': 'volume-b2a82613-7657-4d51-ace3-742ca137b7ee', 'volume_size': 1, 'image_id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--30614709', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a7f0f1878614684af2940ec3fb9d3b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'created_at': datetime.datetime(2025, 9, 23, 13, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 26, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728947460>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e7b740-11ad-467f-8145-3b2d2739949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e7b740-11ad-467f-8145-3b2d2739949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3362bc-bfff-4e42-af00-1a96728181d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:31 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume b2a82613-7657-4d51-ace3-742ca137b7ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2a82613-7657-4d51-ace3-742ca137b7ee', 'volume_size': 1, 'image_id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--30614709', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a7f0f1878614684af2940ec3fb9d3b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'created_at': datetime.datetime(2025, 9, 23, 13, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 26, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728947460>}
Sep 23 15:26:31 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Cloning b2a82613-7657-4d51-ace3-742ca137b7ee from image 8e593ee1-fcae-4612-b96c-54edf53ed8cd  at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:26:33 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD, size 20.69 MB, duration 2.00 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:26:33 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Image download 20.69 MB at 10.32 MB/s
Sep 23 15:26:33 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf47d9c-d436-4a6c-8790-4302cbba7e8f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:33 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD
Sep 23 15:26:33 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:26:36 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Sep 23 15:26:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD" returned: 0 in 3.426s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:36 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Temporary image 8e593ee1-fcae-4612-b96c-54edf53ed8cd is fetched for user 49f2a5e67cbd486a9ebb9388e3000068. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:26:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1431e047-cfab-4853-9fdc-1b431bdbf9f0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:38 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD
Sep 23 15:26:38 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:26:40 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD" returned: 0 in 3.253s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-807335653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a82613-7657-4d51-ace3-742ca137b7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7f0f1878614684af2940ec3fb9d3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:27Z,use_quota=True,user_id='49f2a5e67cbd486a9ebb9388e3000068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c3b0bd2-30b0-41c4-9496-0f86b4447101),volume_type_id=2c3b0bd2-30b0-41c4-9496-0f86b4447101)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Creating volume b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:26:41 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:41 devstack quobyte-client[84024]: System call of process 96958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:41 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=106, name=volume-b2a82613-7657-4d51-ace3-742ca137b7ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee 1073741824" returned: 0 in 0.444s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 0 in 0.146s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] <== create_volume: return (772ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:26:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:42 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Attempting download of 8e593ee1-fcae-4612-b96c-54edf53ed8cd ((None, [{'url': 'file:///opt/stack/data/glance/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'metadata': {}}])) to volume b2a82613-7657-4d51-ace3-742ca137b7ee. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:26:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c594dad3-5128-4d5b-95c9-5c84ff6a7c41]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e593ee1-fcae-4612-b96c-54edf53ed8cd_mxbwsj6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e593ee1-fcae-4612-b96c-54edf53ed8cd_mxbwsj6f" returned: 0 in 0.705s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e593ee1-fcae-4612-b96c-54edf53ed8cd_mxbwsj6f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e593ee1-fcae-4612-b96c-54edf53ed8cd_mxbwsj6f" returned: 1 in 0.708s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e593ee1-fcae-4612-b96c-54edf53ed8cd_mxbwsj6f' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:26:43 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb29bae5-b164-4f6a-ae8a-62f2316c703b]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:44 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] 8e593ee1-fcae-4612-b96c-54edf53ed8cd was qcow2, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:26:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:44 devstack quobyte-client[84024]: System call of process 96970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:45 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=106, name=volume-b2a82613-7657-4d51-ace3-742ca137b7ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 0 in 1.414s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:46 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e593ee1-fcae-4612-b96c-54edf53ed8cd_z3pf78dedevstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:26:46 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Converted 112.00 MB image at 76.39 MB/s
Sep 23 15:26:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:46 devstack quobyte-client[84024]: System call of process 96979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee 1G" returned: 0 in 0.220s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:46 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c828fb4-1e1b-49db-933b-c5517117d89d]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:47 devstack quobyte-client[84024]: System call of process 96982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 0 in 1.022s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Flow 'volume_create_manager' (97dee7a5-5c8f-4db8-a96b-4ffbd2b3f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb1666d-0de7-417d-b669-751486e8d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb1666d-0de7-417d-b669-751486e8d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272865699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a9ab4f-6153-4b87-a200-356f77e49c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c642bd2f4ba74808839c22bd75614643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:47Z,use_quota=True,user_id='b074dfdfadfd4182ad44cc66ea4adbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c737cd7f-6972-40a8-94e9-e03a92bd977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c737cd7f-6972-40a8-94e9-e03a92bd977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b362bc25-606a-4b64-b260-76a8745b2f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b362bc25-606a-4b64-b260-76a8745b2f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a9ab4f-6153-4b87-a200-356f77e49c7d', 'volume_name': 'volume-23a9ab4f-6153-4b87-a200-356f77e49c7d', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b923b60-6ca8-4801-8ce5-c00f79e1fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b923b60-6ca8-4801-8ce5-c00f79e1fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8f2f2b-c5be-4eb5-882f-b85f2ce0f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Volume 23a9ab4f-6153-4b87-a200-356f77e49c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a9ab4f-6153-4b87-a200-356f77e49c7d', 'volume_size': 1}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272865699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a9ab4f-6153-4b87-a200-356f77e49c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c642bd2f4ba74808839c22bd75614643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:26:47Z,use_quota=True,user_id='b074dfdfadfd4182ad44cc66ea4adbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Creating volume 23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:26:48 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 1 in 1.001s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Downloaded image 8e593ee1-fcae-4612-b96c-54edf53ed8cd ((None, [{'url': 'file:///opt/stack/data/glance/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'metadata': {}}])) to volume b2a82613-7657-4d51-ace3-742ca137b7ee successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Temporary image 8e593ee1-fcae-4612-b96c-54edf53ed8cd for user 49f2a5e67cbd486a9ebb9388e3000068 is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:26:48 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Marking volume b2a82613-7657-4d51-ace3-742ca137b7ee as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:26:48 devstack quobyte-client[84024]: System call of process 96990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:26:48 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=107, name=volume-23a9ab4f-6153-4b87-a200-356f77e49c7d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Copying metadata from image 8e593ee1-fcae-4612-b96c-54edf53ed8cd to b2a82613-7657-4d51-ace3-742ca137b7ee. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Creating volume glance metadata for volume b2a82613-7657-4d51-ace3-742ca137b7ee backed by image 8e593ee1-fcae-4612-b96c-54edf53ed8cd with: {'image_id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'image_name': 'tempest-scenario-img--30614709', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3362bc-bfff-4e42-af00-1a96728181d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a82613-7657-4d51-ace3-742ca137b7ee', 'volume_size': 1, 'image_id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--30614709', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7a7f0f1878614684af2940ec3fb9d3b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8e593ee1-fcae-4612-b96c-54edf53ed8cd', 'created_at': datetime.datetime(2025, 9, 23, 13, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 26, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e593ee1-fcae-4612-b96c-54edf53ed8cd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728947460>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa686f4-4580-42a2-b4c1-08dc5f1b899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d 1073741824" returned: 0 in 0.761s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:26:49 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume volume-b2a82613-7657-4d51-ace3-742ca137b7ee (b2a82613-7657-4d51-ace3-742ca137b7ee): created successfully
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa686f4-4580-42a2-b4c1-08dc5f1b899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Flow 'volume_create_manager' (aa803517-2cbe-4739-922a-408e7970a532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.493s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] <== create_volume: return (1281ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:26:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d19f1dbe-1db8-49ba-b22a-f89bb35c2b21 tempest-TestInstancesWithCinderVolumes-1823528635 None] Created volume successfully.
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8f2f2b-c5be-4eb5-882f-b85f2ce0f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a9ab4f-6153-4b87-a200-356f77e49c7d', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599ec38b-ee8f-418f-b35f-486b4cb6dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:26:49 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Volume volume-23a9ab4f-6153-4b87-a200-356f77e49c7d (23a9ab4f-6153-4b87-a200-356f77e49c7d): created successfully
Sep 23 15:26:49 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599ec38b-ee8f-418f-b35f-486b4cb6dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:26:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Flow 'volume_create_manager' (97dee7a5-5c8f-4db8-a96b-4ffbd2b3f974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:26:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f42f74e4-aed3-4ab2-ae9e-811fdbd5c1da tempest-VolumesActionsTest-1955364526 None] Created volume successfully.
Sep 23 15:26:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:26:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:26:59 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e615cb-8c06-4b5a-bb99-71ec317b136f]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:26:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 0 in 0.605s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:00 devstack quobyte-client[84024]: System call of process 97008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:27:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 1 in 0.644s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:27:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.386s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:27:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-b2a82613-7657-4d51-ace3-742ca137b7ee', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '044e0c1d-b60b-493b-aebe-f16b9c692310', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:27:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:27:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-5594c7e1-48a5-4699-95ac-acfa2a216fca req-c2ae2d93-fdb9-433f-b40c-a0a170fe4263 tempest-TestInstancesWithCinderVolumes-1823528635 None] attachment_update completed successfully.
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.168s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:27:11 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:27:11 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=50,cinder:SELECT=43,cinder:INSERT=17,cinder:DELETE=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:27:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a20a034-5d18-4206-8bc7-740cf65a919d tempest-VolumesActionsTest-1955364526 None] Acquiring lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d" by "attach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:27:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a20a034-5d18-4206-8bc7-740cf65a919d tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d" acquired by "attach_volume" :: waited 0.359s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:27:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:27:39 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:27:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Flow 'volume_create_manager' (87b30bb1-d5ed-4653-9082-ab57c70f1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:27:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2620900-26a9-41fc-96de-21e2dd0ac103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2620900-26a9-41fc-96de-21e2dd0ac103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-90018157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65453339-aaaa-4e1e-b8c6-417e810ff24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b65b636c90a49c38be59df26ceec9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:27:39Z,use_quota=True,user_id='9b5f696b90f947f99341b3181088da24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adec095d-0fe4-4811-9008-9fb232e8f578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adec095d-0fe4-4811-9008-9fb232e8f578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bedb8db-45e0-40fe-80dd-5a238ba34d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bedb8db-45e0-40fe-80dd-5a238ba34d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65453339-aaaa-4e1e-b8c6-417e810ff24e', 'volume_name': 'volume-65453339-aaaa-4e1e-b8c6-417e810ff24e', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a0e9d1-380d-4dc7-97bc-d1e8eaaffe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a0e9d1-380d-4dc7-97bc-d1e8eaaffe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c367e58-1ad6-4867-a7e3-40d4d179ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:40 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume 65453339-aaaa-4e1e-b8c6-417e810ff24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65453339-aaaa-4e1e-b8c6-417e810ff24e', 'volume_size': 1}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-90018157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65453339-aaaa-4e1e-b8c6-417e810ff24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b65b636c90a49c38be59df26ceec9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:27:39Z,use_quota=True,user_id='9b5f696b90f947f99341b3181088da24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Creating volume 65453339-aaaa-4e1e-b8c6-417e810ff24e {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:27:40 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:27:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:40 devstack quobyte-client[84024]: System call of process 97650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:27:41 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=108, name=volume-65453339-aaaa-4e1e-b8c6-417e810ff24e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:27:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:27:42 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Flow 'volume_create_manager' (88f3c841-c668-4bc6-83c7-4f012da0f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f6fffc-d8fe-4cd7-b28d-c66ba316d71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e 1073741824" returned: 0 in 3.311s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f6fffc-d8fe-4cd7-b28d-c66ba316d71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1055252834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1fd432-5621-4d33-b573-1ae4d79f4bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b65b636c90a49c38be59df26ceec9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:27:40Z,use_quota=True,user_id='9b5f696b90f947f99341b3181088da24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07c9786-2aec-4c85-b0c1-7c6df9daab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07c9786-2aec-4c85-b0c1-7c6df9daab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01696618-dcb4-4310-9e69-bb323f10b658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01696618-dcb4-4310-9e69-bb323f10b658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1fd432-5621-4d33-b573-1ae4d79f4bf5', 'volume_name': 'volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ada5f39-a059-47b7-a316-b7f40f27a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ada5f39-a059-47b7-a316-b7f40f27a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ca4fe0-9479-42c1-91e6-22fd9274faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:43 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume 8d1fd432-5621-4d33-b573-1ae4d79f4bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5', 'volume_size': 1}
Sep 23 15:27:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:27:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:44 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9a20a034-5d18-4206-8bc7-740cf65a919d tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:27:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9a20a034-5d18-4206-8bc7-740cf65a919d tempest-VolumesActionsTest-1955364526 None] Attaching volume 23a9ab4f-6153-4b87-a200-356f77e49c7d to instance 87a07568-0494-4183-b26a-e9a9bc4cdaf8 at mountpoint /dev/vdb on host None.
Sep 23 15:27:45 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9a20a034-5d18-4206-8bc7-740cf65a919d tempest-VolumesActionsTest-1955364526 None] Attach volume completed successfully.
Sep 23 15:27:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e" returned: 0 in 1.856s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] <== create_volume: return (5468ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:27:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.499s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1055252834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1fd432-5621-4d33-b573-1ae4d79f4bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b65b636c90a49c38be59df26ceec9fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:27:40Z,use_quota=True,user_id='9b5f696b90f947f99341b3181088da24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Creating volume 8d1fd432-5621-4d33-b573-1ae4d79f4bf5 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:27:46 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:27:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:46 devstack quobyte-client[84024]: System call of process 97658 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:27:46 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=109, name=volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:27:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c367e58-1ad6-4867-a7e3-40d4d179ee25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65453339-aaaa-4e1e-b8c6-417e810ff24e', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892e5a4f-5f0c-44c5-b3db-a95728b90485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9a20a034-5d18-4206-8bc7-740cf65a919d tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d" released by "attach_volume" :: held 9.119s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:27:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 1073741824" returned: 0 in 2.863s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:27:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume volume-65453339-aaaa-4e1e-b8c6-417e810ff24e (65453339-aaaa-4e1e-b8c6-417e810ff24e): created successfully
Sep 23 15:27:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892e5a4f-5f0c-44c5-b3db-a95728b90485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Flow 'volume_create_manager' (87b30bb1-d5ed-4653-9082-ab57c70f1245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:27:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Acquiring lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-detach_volume" by "detach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:27:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" returned: 0 in 2.579s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:27:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] <== create_volume: return (5669ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:27:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.735s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:27:51 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2d81aa7f-64d6-40a2-910f-11081b87e4e4 tempest-TestServerVolumeAttachmentScenario-264077252 None] Created volume successfully.
Sep 23 15:27:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-detach_volume" acquired by "detach_volume" :: waited 0.669s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:27:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:27:52 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Detaching volume 23a9ab4f-6153-4b87-a200-356f77e49c7d from instance 87a07568-0494-4183-b26a-e9a9bc4cdaf8.
Sep 23 15:27:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:27:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ca4fe0-9479-42c1-91e6-22fd9274faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9b527b-edb3-4a66-b9a9-774fe2d196a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:27:53 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 (8d1fd432-5621-4d33-b573-1ae4d79f4bf5): created successfully
Sep 23 15:27:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9b527b-edb3-4a66-b9a9-774fe2d196a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:27:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Flow 'volume_create_manager' (88f3c841-c668-4bc6-83c7-4f012da0f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:27:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0402e730-08eb-4974-a0d3-99c7b4986cd5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Created volume successfully.
Sep 23 15:27:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Detach volume completed successfully.
Sep 23 15:27:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-45fdd931-e44d-48c1-8ed0-3d98e3aa0e94 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-detach_volume" released by "detach_volume" :: held 1.422s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.305s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:28:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:28:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:28:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=9,cinder:SELECT=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:28:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07188bc4-43e5-40ab-b447-0d318f10cadb tempest-VolumesActionsTest-1955364526 None] Acquiring lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d" by "attach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:28:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07188bc4-43e5-40ab-b447-0d318f10cadb tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d" acquired by "attach_volume" :: waited 0.030s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:28:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-07188bc4-43e5-40ab-b447-0d318f10cadb tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:28:45 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-07188bc4-43e5-40ab-b447-0d318f10cadb tempest-VolumesActionsTest-1955364526 None] Attaching volume 23a9ab4f-6153-4b87-a200-356f77e49c7d to instance 8cd96feb-b350-4167-955a-42328d6dcd54 at mountpoint /dev/vdb on host None.
Sep 23 15:28:45 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-07188bc4-43e5-40ab-b447-0d318f10cadb tempest-VolumesActionsTest-1955364526 None] Attach volume completed successfully.
Sep 23 15:28:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-07188bc4-43e5-40ab-b447-0d318f10cadb tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d" released by "attach_volume" :: held 0.723s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:28:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Acquiring lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-detach_volume" by "detach_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:28:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:28:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:28:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Detaching volume 23a9ab4f-6153-4b87-a200-356f77e49c7d from instance 8cd96feb-b350-4167-955a-42328d6dcd54.
Sep 23 15:28:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:28:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Detach volume completed successfully.
Sep 23 15:28:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7472a995-12d7-43c8-bb71-b7fc45c1d0f4 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:28:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:28:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:28:52 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce6238c-2f5e-4637-aaa7-a289a90d0bfa]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:28:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:28:54 devstack quobyte-client[84024]: System call of process 98046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:28:54 devstack quobyte-client[84024]: System call of process 98046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:28:54 devstack quobyte-client[84024]: System call of process 98046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:28:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3" returned: 0 in 1.525s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:28:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.681s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:28:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-57703639-cb6e-4315-b1c0-4488964862a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d67315c-2724-4d52-b029-715697104a00', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:28:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:28:55 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-17d327eb-166c-4661-b15f-8a71d7fc91d7 req-27a08383-67de-4f3a-91d8-dface7deaea3 tempest-TestInstancesWithCinderVolumes-1823528635 None] attachment_update completed successfully.
Sep 23 15:29:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6f5533-da87-4c10-9259-43e070a12b2a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:02 devstack quobyte-client[84024]: System call of process 98064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.577s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a4afe-bfc4-4bff-899e-5d904f061742]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:29:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:03 devstack quobyte-client[84024]: System call of process 98069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:29:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.479s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.ca672cef-a2bf-4f36-88a8-3e43d1fdc98des9o4mfu.img {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:03 devstack quobyte-client[84024]: System call of process 98073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:29:05 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:INSERT=2,cinder:SELECT=14,cinder:UPDATE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.133s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:29:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.469s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:29:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.ca672cef-a2bf-4f36-88a8-3e43d1fdc98des9o4mfu.img" returned: 0 in 8.026s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6909107-aed1-4c4a-99ac-39158ecff909]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:29:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:12 devstack quobyte-client[84024]: System call of process 98122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:29:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:29:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.758s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:12 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Image conversion details: src /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.ca672cef-a2bf-4f36-88a8-3e43d1fdc98des9o4mfu.img {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:29:12 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Converted 1024.00 MB image at 127.03 MB/s
Sep 23 15:29:12 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] ca672cef-a2bf-4f36-88a8-3e43d1fdc98d was raw, no need to convert to raw {{(pid=84009) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 23 15:29:22 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:29:22 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:29:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:29:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 55.321s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:29:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Uploaded volume to glance image-id: ca672cef-a2bf-4f36-88a8-3e43d1fdc98d. {{(pid=84009) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 23 15:29:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 45.424s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:29:57 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393cdd3-ffb5-4d11-8dd3-344100959614]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:29:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f9c0d9bf-99c2-4b9d-a6f2-8eb3a474e4ab tempest-VolumesActionsTest-1955364526 None] Copy volume to image completed successfully.
Sep 23 15:29:58 devstack quobyte-client[84024]: System call of process 98241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21" returned: 0 in 0.479s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.557s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.200s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc53abb6-abf4-4bc1-95eb-489f72a34115]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e" returned: 0 in 0.506s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.597s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5663e89b-ba63-4005-bca3-cfd41a33e2eb', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:29:58 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:29:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-65453339-aaaa-4e1e-b8c6-417e810ff24e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55d69f6e-19a0-407d-a465-9b1b10d7ac3a', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:29:58 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:29:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-1d9c9b07-9fd8-4999-912e-85ee45c044ae req-f7688ec5-957a-48a7-9523-76f774749f54 tempest-TestInstancesWithCinderVolumes-1823528635 None] attachment_update completed successfully.
Sep 23 15:29:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-1ec44555-7fe3-47f4-84eb-c06bcef892d7 req-743c5588-4ccd-46bc-944f-3c629a3590b5 tempest-TestServerVolumeAttachmentScenario-264077252 None] attachment_update completed successfully.
Sep 23 15:30:00 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:00 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[647fd1e8-c909-4672-be54-eec01e9844f2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:01 devstack quobyte-client[84024]: System call of process 98256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:01 devstack quobyte-client[84024]: System call of process 98256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.549s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[811199c2-a4df-4819-ab18-aad18e179eec]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:02 devstack quobyte-client[84024]: System call of process 98264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:02 devstack quobyte-client[84024]: System call of process 98264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:02 devstack quobyte-client[84024]: System call of process 98264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.578s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:02 devstack quobyte-client[84024]: System call of process 98268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:02 devstack quobyte-client[84024]: System call of process 98268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:02 devstack quobyte-client[84024]: System call of process 98268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img" returned: 0 in 6.757s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad6694e-a62b-4bd9-9b5b-e608a05cd9c5]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:09 devstack quobyte-client[84024]: System call of process 98291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:09 devstack quobyte-client[84024]: System call of process 98291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.196s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.994s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:09 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Image conversion details: src /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:30:09 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Converted 1024.00 MB image at 150.98 MB/s
Sep 23 15:30:10 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] 0082d5e9-6efd-487f-b9c6-9df0e178bf7c was raw, converting to qcow2 {{(pid=84009) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 23 15:30:10 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f8942-fc0d-4ff3-82e7-04f27722d68b]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img" returned: 0 in 0.468s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img" returned: 1 in 0.562s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img /opt/stack/data/cinder/conversion/vol_upload_qef6x35x {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img /opt/stack/data/cinder/conversion/vol_upload_qef6x35x" returned: 0 in 0.200s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Image conversion details: src /opt/stack/data/cinder/conversion/23a9ab4f-6153-4b87-a200-356f77e49c7d.temp_image.0082d5e9-6efd-487f-b9c6-9df0e178bf7coujt4tyy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qef6x35x {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:30:11 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e3dd7a-6a77-47c0-8039-145431208275]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qef6x35x {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qef6x35x" returned: 0 in 0.545s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.769s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Uploaded volume to glance image-id: 0082d5e9-6efd-487f-b9c6-9df0e178bf7c. {{(pid=84009) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 23 15:30:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c7781bb1-31a4-4ab8-95a8-06ccea56ebca tempest-VolumesActionsTest-1955364526 None] Copy volume to image completed successfully.
Sep 23 15:30:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Acquiring lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Acquiring lock "cinder-quobyte-23a9ab4f-6153-4b87-a200-356f77e49c7d" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-quobyte-23a9ab4f-6153-4b87-a200-356f77e49c7d" acquired by "delete_volume" :: waited 0.025s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c771c-1264-40ec-b355-cb48ce340583]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.646s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-23a9ab4f-6153-4b87-a200-356f77e49c7d" returned: 0 in 0.218s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-quobyte-23a9ab4f-6153-4b87-a200-356f77e49c7d" released by "delete_volume" :: held 1.225s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:17 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Created reservations ['35c463ce-b06a-4153-a81b-b0adef09ea78', 'bab45d12-8c91-485f-8086-7c05a3bfe99b', 'af0af46f-0ba1-4198-b14f-04d2ef29c5dd', '6a1a2969-330d-4969-af8d-d41c3403c634'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:30:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac80a1-95d5-4ee9-b39f-d0fb83b5ae1f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:18 devstack quobyte-client[84024]: System call of process 98361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" returned: 0 in 0.770s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.419s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:30:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Deleted volume successfully.
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72098d76-ff1d-4ffc-91e9-97805986fe5e', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:30:18 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2cf20d8f-7bd1-41c4-80cf-3e32b45b6536 tempest-VolumesActionsTest-1955364526 None] Lock "cinder-23a9ab4f-6153-4b87-a200-356f77e49c7d-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-de87e7f4-00d4-4379-b37b-c15603e17fcc req-c6deba9d-3478-432b-a4db-8e8665fa8558 tempest-TestServerVolumeAttachmentScenario-264077252 None] attachment_update completed successfully.
Sep 23 15:30:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Flow 'volume_create_manager' (409275a0-5d0d-4460-ba6d-a5fb339ec67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec72c1c0-8417-4db2-9009-d587a2a460fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec72c1c0-8417-4db2-9009-d587a2a460fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1386545008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5355fa92-a8c1-484e-9e0e-e10bedee655a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fa50de456c4eb7b44b274030b55c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:28Z,use_quota=True,user_id='5dc37b496ae843dcbd283ed423421b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13aca8a-8335-4de6-8fe7-6fdc9f70c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13aca8a-8335-4de6-8fe7-6fdc9f70c981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db02741-d316-46ae-97e4-f92c8a4861cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db02741-d316-46ae-97e4-f92c8a4861cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5355fa92-a8c1-484e-9e0e-e10bedee655a', 'volume_name': 'volume-5355fa92-a8c1-484e-9e0e-e10bedee655a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ab5acf-d4c5-4ed2-835a-3ce6ab9b5bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ab5acf-d4c5-4ed2-835a-3ce6ab9b5bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2344f6eb-767e-402e-a438-4dbccc6c0f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:27 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Volume 5355fa92-a8c1-484e-9e0e-e10bedee655a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5355fa92-a8c1-484e-9e0e-e10bedee655a', 'volume_size': 1}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1386545008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5355fa92-a8c1-484e-9e0e-e10bedee655a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fa50de456c4eb7b44b274030b55c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:28Z,use_quota=True,user_id='5dc37b496ae843dcbd283ed423421b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Creating volume 5355fa92-a8c1-484e-9e0e-e10bedee655a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:30:27 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:30:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:28 devstack quobyte-client[84024]: System call of process 98379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:28 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=110, name=volume-5355fa92-a8c1-484e-9e0e-e10bedee655a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a 1073741824" returned: 0 in 0.363s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a" returned: 0 in 0.085s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] <== create_volume: return (519ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.531s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2344f6eb-767e-402e-a438-4dbccc6c0f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5355fa92-a8c1-484e-9e0e-e10bedee655a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3ff46a-b593-43bc-a06a-9a21636a85d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:28 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Volume volume-5355fa92-a8c1-484e-9e0e-e10bedee655a (5355fa92-a8c1-484e-9e0e-e10bedee655a): created successfully
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3ff46a-b593-43bc-a06a-9a21636a85d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:28 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Flow 'volume_create_manager' (409275a0-5d0d-4460-ba6d-a5fb339ec67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:28 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c36e2677-9e23-455a-8adb-a128e1f4648c tempest-VolumesListTestJSON-510973683 None] Created volume successfully.
Sep 23 15:30:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Flow 'volume_create_manager' (d154113a-3599-4099-98fc-b11a428272a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f150a52d-89f6-4db7-804f-3983a8879d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f150a52d-89f6-4db7-804f-3983a8879d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-57314996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fa50de456c4eb7b44b274030b55c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:30Z,use_quota=True,user_id='5dc37b496ae843dcbd283ed423421b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f22e7c-94c8-48b6-80c9-a1ab55b15341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f22e7c-94c8-48b6-80c9-a1ab55b15341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88538a9b-9e85-48d6-9dcc-b30cf955aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88538a9b-9e85-48d6-9dcc-b30cf955aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22', 'volume_name': 'volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944718cb-4ff4-41c4-91b0-b968c7e2c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944718cb-4ff4-41c4-91b0-b968c7e2c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be98b766-dbd5-4c91-9e58-fcf4aabe3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:30 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Volume cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22', 'volume_size': 1}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-57314996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fa50de456c4eb7b44b274030b55c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:30Z,use_quota=True,user_id='5dc37b496ae843dcbd283ed423421b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Creating volume cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:30:30 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:30 devstack quobyte-client[84024]: System call of process 98389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:30 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=111, name=volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 1073741824" returned: 0 in 0.358s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22" returned: 0 in 0.084s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] <== create_volume: return (506ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.517s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be98b766-dbd5-4c91-9e58-fcf4aabe3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec1b66b-8c36-43ba-8a53-4b26d682515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:31 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Volume volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 (cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22): created successfully
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec1b66b-8c36-43ba-8a53-4b26d682515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Flow 'volume_create_manager' (d154113a-3599-4099-98fc-b11a428272a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:31 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3dee6481-5afa-488c-8454-18a41eb44c14 tempest-VolumesListTestJSON-510973683 None] Created volume successfully.
Sep 23 15:30:33 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Flow 'volume_create_manager' (3625296c-2610-48b7-87ba-acb6babd700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6bf355-c8d0-4dd9-9975-c6625fbfdd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6bf355-c8d0-4dd9-9975-c6625fbfdd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2010720796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd1c233-a4cb-44da-b580-54201c839d79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fa50de456c4eb7b44b274030b55c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:33Z,use_quota=True,user_id='5dc37b496ae843dcbd283ed423421b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8783a1-2e02-41ff-89f5-93d7f54fc064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8783a1-2e02-41ff-89f5-93d7f54fc064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306bfb80-3bdc-48f0-ab74-637d54114541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306bfb80-3bdc-48f0-ab74-637d54114541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd1c233-a4cb-44da-b580-54201c839d79', 'volume_name': 'volume-dfd1c233-a4cb-44da-b580-54201c839d79', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e869f6a-a167-4004-a088-6a32f9960647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e869f6a-a167-4004-a088-6a32f9960647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6b19a8-06d0-4f87-aea8-d13e7ce6e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:33 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Volume dfd1c233-a4cb-44da-b580-54201c839d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd1c233-a4cb-44da-b580-54201c839d79', 'volume_size': 1}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2010720796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd1c233-a4cb-44da-b580-54201c839d79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78fa50de456c4eb7b44b274030b55c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:33Z,use_quota=True,user_id='5dc37b496ae843dcbd283ed423421b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Creating volume dfd1c233-a4cb-44da-b580-54201c839d79 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:30:33 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:33 devstack quobyte-client[84024]: System call of process 98393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:33 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=112, name=volume-dfd1c233-a4cb-44da-b580-54201c839d79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79 1073741824" returned: 0 in 0.389s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79" returned: 0 in 0.089s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:30:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6b19a8-06d0-4f87-aea8-d13e7ce6e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd1c233-a4cb-44da-b580-54201c839d79', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be056c3a-e4e6-4d6d-bb18-dd9ec11632ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:34 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Volume volume-dfd1c233-a4cb-44da-b580-54201c839d79 (dfd1c233-a4cb-44da-b580-54201c839d79): created successfully
Sep 23 15:30:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be056c3a-e4e6-4d6d-bb18-dd9ec11632ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Flow 'volume_create_manager' (3625296c-2610-48b7-87ba-acb6babd700a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:34 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-73e8f308-e67b-4025-aa30-3a24a9efa2b1 tempest-VolumesListTestJSON-510973683 None] Created volume successfully.
Sep 23 15:30:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-9f00345a-0ea8-4fe0-9855-cc369b94af12 req-a984ab0e-bd1e-435b-8f82-2cd3f4c3f6c1 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-9f00345a-0ea8-4fe0-9855-cc369b94af12 req-a984ab0e-bd1e-435b-8f82-2cd3f4c3f6c1 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:37 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-9f00345a-0ea8-4fe0-9855-cc369b94af12 req-a984ab0e-bd1e-435b-8f82-2cd3f4c3f6c1 tempest-TestInstancesWithCinderVolumes-1823528635 None] Terminate volume connection completed successfully.
Sep 23 15:30:37 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-9f00345a-0ea8-4fe0-9855-cc369b94af12 req-a984ab0e-bd1e-435b-8f82-2cd3f4c3f6c1 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deleting attachment 6d67315c-2724-4d52-b029-715697104a00. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Acquiring lock "cinder-dfd1c233-a4cb-44da-b580-54201c839d79-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "cinder-57703639-cb6e-4315-b1c0-4488964862a3-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Lock "cinder-dfd1c233-a4cb-44da-b580-54201c839d79-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-57703639-cb6e-4315-b1c0-4488964862a3-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "cinder-quobyte-57703639-cb6e-4315-b1c0-4488964862a3" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Acquiring lock "cinder-quobyte-dfd1c233-a4cb-44da-b580-54201c839d79" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-quobyte-57703639-cb6e-4315-b1c0-4488964862a3" acquired by "delete_volume" :: waited 0.024s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Lock "cinder-quobyte-dfd1c233-a4cb-44da-b580-54201c839d79" acquired by "delete_volume" :: waited 0.042s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[925682de-99f9-4734-96d9-38c4597d4b6e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f97d5d-40da-4aa6-af7e-98e7441eac7e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3" returned: 0 in 0.617s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:40 devstack quobyte-client[84024]: System call of process 98436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79" returned: 0 in 0.770s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-57703639-cb6e-4315-b1c0-4488964862a3" returned: 0 in 0.301s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dfd1c233-a4cb-44da-b580-54201c839d79" returned: 0 in 0.217s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-quobyte-57703639-cb6e-4315-b1c0-4488964862a3" released by "delete_volume" :: held 1.198s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Lock "cinder-quobyte-dfd1c233-a4cb-44da-b580-54201c839d79" released by "delete_volume" :: held 1.367s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:40 devstack cinder-volume[84009]: WARNING cinder.quota [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1351659200-784323871 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1351659200-784323871, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:30:40 devstack cinder-volume[84009]: WARNING cinder.quota [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1351659200-784323871 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1351659200-784323871, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Created reservations ['5810ce08-3173-4f7c-bc6a-989f11484866', '40df76f6-ce2e-4fa7-b743-84bf9b41cc09', '0b0eb50e-ff4b-4f33-9912-a6d73e5f9411', 'f576385e-61c0-46e6-a07c-5969ec4f0b3d'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Created reservations ['44189336-413e-4bc6-b934-d024fddf47d9', 'be1379e8-260b-461d-9fd8-f2dd6c19d441', '82aecb6b-7117-4798-bb70-4a640c1736fe', '32416be0-4c3f-48ff-b4ac-eb162dbb4943'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "cinder-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.872s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:30:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deleted volume successfully.
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.701s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22-delete_volume" acquired by "delete_volume" :: waited 0.377s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:30:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Deleted volume successfully.
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-de97bc8e-b0f9-4382-9883-d3bdf54b1061 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-57703639-cb6e-4315-b1c0-4488964862a3-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:42 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=42,cinder:UPDATE=31,cinder:DELETE=1,cinder:INSERT=4 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:30:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-658679b9-9e9f-4d13-b2ab-7846f1d1be6a tempest-VolumesListTestJSON-510973683 None] Lock "cinder-dfd1c233-a4cb-44da-b580-54201c839d79-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:43 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "cinder-quobyte-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:43 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-quobyte-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22" acquired by "delete_volume" :: waited 0.025s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:43 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5613e928-6877-418e-aa16-e4f2298a0930]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:43 devstack quobyte-client[84024]: System call of process 98460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22" returned: 0 in 0.798s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22" returned: 0 in 0.115s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-quobyte-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22" released by "delete_volume" :: held 1.132s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Created reservations ['d3edfe95-e43b-4353-b670-e8a5535afdb9', '80d44ce5-8409-4244-8ef8-9477472cfa22', 'ea126b46-13e3-45a3-a52f-62274426419f', '416bff5a-68c5-44d9-9356-3c4d244c201d'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.110s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:44 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:30:45 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Deleted volume successfully.
Sep 23 15:30:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-90aae352-9cf5-4515-adbd-2d4c5fe861c1 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-cb7bdd08-ddc2-44fc-847e-7b08fe0ebd22-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "cinder-5355fa92-a8c1-484e-9e0e-e10bedee655a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-5355fa92-a8c1-484e-9e0e-e10bedee655a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "cinder-quobyte-5355fa92-a8c1-484e-9e0e-e10bedee655a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-quobyte-5355fa92-a8c1-484e-9e0e-e10bedee655a" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:46 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba01ef-7920-4b1c-abd8-fda9790ebc1a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a" returned: 0 in 0.525s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5355fa92-a8c1-484e-9e0e-e10bedee655a" returned: 0 in 0.135s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-quobyte-5355fa92-a8c1-484e-9e0e-e10bedee655a" released by "delete_volume" :: held 0.869s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a3c80916-6461-46cb-8a09-a9f5ca367a39 req-b2f13680-bc32-4a67-9278-60a8109a1e96 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a3c80916-6461-46cb-8a09-a9f5ca367a39 req-b2f13680-bc32-4a67-9278-60a8109a1e96 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-a3c80916-6461-46cb-8a09-a9f5ca367a39 req-b2f13680-bc32-4a67-9278-60a8109a1e96 tempest-TestServerVolumeAttachmentScenario-264077252 None] Terminate volume connection completed successfully.
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-a3c80916-6461-46cb-8a09-a9f5ca367a39 req-b2f13680-bc32-4a67-9278-60a8109a1e96 tempest-TestServerVolumeAttachmentScenario-264077252 None] Deleting attachment 72098d76-ff1d-4ffc-91e9-97805986fe5e. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Created reservations ['8d43f0bc-a96e-43f8-8884-0965937812f6', 'd9407341-44cd-48c1-8c43-48891cbe7592', '5fc38173-a96f-4609-80b1-897552b007b9', 'e0280ba1-9bd4-43f6-a452-609e36df53ff'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.157s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:47 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:30:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Deleted volume successfully.
Sep 23 15:30:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0ffdc4f6-f97e-49d1-82f4-cc7e5f29a7e6 tempest-VolumesListTestJSON-510973683 None] Lock "cinder-5355fa92-a8c1-484e-9e0e-e10bedee655a-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Flow 'volume_create_manager' (6d4d2f57-d1cb-426a-8229-9cd88de8a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a2f8e2-9753-413a-acdd-400243d02cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a2f8e2-9753-413a-acdd-400243d02cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-664585012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7374f8ba-e964-401a-9974-74dcb7f2d347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73841c8b55b44868bf49d9c9f63e6ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:52Z,use_quota=True,user_id='c3201885c7f44d9d9f7f4f8d0eafc9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d045a07c-5dc8-4304-bb9c-2d3ffbc70c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d045a07c-5dc8-4304-bb9c-2d3ffbc70c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a4d7de-86b2-444e-9cd5-cc80848704bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a4d7de-86b2-444e-9cd5-cc80848704bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7374f8ba-e964-401a-9974-74dcb7f2d347', 'volume_name': 'volume-7374f8ba-e964-401a-9974-74dcb7f2d347', 'volume_size': 2}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcf8cad-7d27-4290-b94f-0f3480b8f687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcf8cad-7d27-4290-b94f-0f3480b8f687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8a3220-1362-44fb-9d01-4a5016bcdf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:52 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume 7374f8ba-e964-401a-9974-74dcb7f2d347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7374f8ba-e964-401a-9974-74dcb7f2d347', 'volume_size': 2}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-664585012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7374f8ba-e964-401a-9974-74dcb7f2d347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e73841c8b55b44868bf49d9c9f63e6ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:30:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:30:52Z,use_quota=True,user_id='c3201885c7f44d9d9f7f4f8d0eafc9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Creating volume 7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:30:52 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:30:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 2147483648 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:52 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=113, name=volume-7374f8ba-e964-401a-9974-74dcb7f2d347, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 2147483648" returned: 0 in 0.473s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347" returned: 0 in 0.129s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] <== create_volume: return (671ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8a3220-1362-44fb-9d01-4a5016bcdf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7374f8ba-e964-401a-9974-74dcb7f2d347', 'volume_size': 2}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f316228-2cae-4198-af7a-865b9f3f6bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:30:53 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume volume-7374f8ba-e964-401a-9974-74dcb7f2d347 (7374f8ba-e964-401a-9974-74dcb7f2d347): created successfully
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f316228-2cae-4198-af7a-865b9f3f6bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:30:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Flow 'volume_create_manager' (6d4d2f57-d1cb-426a-8229-9cd88de8a815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:30:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f2faafe6-586b-423e-a3ff-af2fe0739ddc tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Created volume successfully.
Sep 23 15:30:54 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:30:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:30:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Creating offline snapshot b354a00e-e623-44e0-9941-e3032f3ab1c0 of volume 7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:30:54 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d3cfb-9910-4b40-bea3-b60f1ba95e1e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347" returned: 0 in 0.411s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 2G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:55 devstack quobyte-client[84024]: System call of process 98505 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:30:55 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=114, name=volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 2G" returned: 0 in 0.325s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7374f8ba-e964-401a-9974-74dcb7f2d347 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "qemu-img rebase -u -b volume-7374f8ba-e964-401a-9974-74dcb7f2d347 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0" returned: 0 in 0.158s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:30:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0" returned: 0 in 0.116s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0" returned: 0 in 0.090s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.info" returned: 0 in 0.096s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.info" returned: 0 in 0.088s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.632s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:30:56 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9678da40-3e7a-4276-b521-c75787ef4120 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Create snapshot completed successfully
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "cinder-b354a00e-e623-44e0-9941-e3032f3ab1c0-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-b354a00e-e623-44e0-9941-e3032f3ab1c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:57 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "cinder-quobyte-7374f8ba-e964-401a-9974-74dcb7f2d347" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-quobyte-7374f8ba-e964-401a-9974-74dcb7f2d347" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "cinder-quobyte-b354a00e-e623-44e0-9941-e3032f3ab1c0" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-quobyte-b354a00e-e623-44e0-9941-e3032f3ab1c0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Deleting offline snapshot b354a00e-e623-44e0-9941-e3032f3ab1c0 of volume 7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] snapshot_file for this snap is: volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb3b20-34b2-4b00-ab83-289c3b51da0b]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0" returned: 0 in 0.427s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7374f8ba-e964-401a-9974-74dcb7f2d347(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eaa33f-fe95-4655-8716-721554e45453]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347" returned: 0 in 0.441s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0" returned: 0 in 0.228s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347.b354a00e-e623-44e0-9941-e3032f3ab1c0" returned: 0 in 0.084s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-quobyte-b354a00e-e623-44e0-9941-e3032f3ab1c0" released by "_delete_snapshot" :: held 1.496s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:58 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-quobyte-7374f8ba-e964-401a-9974-74dcb7f2d347" released by "delete_snapshot" :: held 1.517s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Created reservations ['e75cd41d-8ba1-4cc1-b004-c1b597810f46', '8bca675b-311f-4dae-89a1-63f94103524a', 'b9b26940-8411-4300-baef-16a3115f2077', '093831f0-e249-4059-aa1e-ebb020fe0871'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:30:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Delete snapshot completed successfully.
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7b164743-3216-4944-9ff5-90fb10d9a121 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-b354a00e-e623-44e0-9941-e3032f3ab1c0-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "cinder-7374f8ba-e964-401a-9974-74dcb7f2d347-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-7374f8ba-e964-401a-9974-74dcb7f2d347-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "cinder-quobyte-7374f8ba-e964-401a-9974-74dcb7f2d347" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-quobyte-7374f8ba-e964-401a-9974-74dcb7f2d347" acquired by "delete_volume" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8e83a3-deca-4b08-a27c-860928b8c0ad]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:30:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347" returned: 0 in 0.428s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7374f8ba-e964-401a-9974-74dcb7f2d347" returned: 0 in 0.092s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-quobyte-7374f8ba-e964-401a-9974-74dcb7f2d347" released by "delete_volume" :: held 0.704s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Created reservations ['76d91ccf-1674-4fbf-a718-a6fdeab4055d', 'f68b6ebd-2119-442a-886e-6969a66961d7', '0a89ee89-06f6-4ba4-b442-d0f3bc5c8bd0', '085ca397-132c-45db-b184-c692ba202184'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.085s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:00 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:31:00 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Deleted volume successfully.
Sep 23 15:31:01 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a27503f1-6978-469b-a88a-788826818e09 tempest-VolumesSnapshotNegativeTestJSON-811999462 None] Lock "cinder-7374f8ba-e964-401a-9974-74dcb7f2d347-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.115s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:31:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-8bcf6ea4-8b55-4c1d-8d88-5ec3c1ed111e req-91c7079b-299e-4600-bb54-693590a35492 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:10 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=44,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=7 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:31:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-8bcf6ea4-8b55-4c1d-8d88-5ec3c1ed111e req-91c7079b-299e-4600-bb54-693590a35492 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-8bcf6ea4-8b55-4c1d-8d88-5ec3c1ed111e req-91c7079b-299e-4600-bb54-693590a35492 tempest-TestInstancesWithCinderVolumes-1823528635 None] Terminate volume connection completed successfully.
Sep 23 15:31:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-8bcf6ea4-8b55-4c1d-8d88-5ec3c1ed111e req-91c7079b-299e-4600-bb54-693590a35492 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deleting attachment 5663e89b-ba63-4005-bca3-cfd41a33e2eb. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:31:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-7f285cb6-ac37-4d54-ac24-87effb8d557e req-bd3fdc19-b053-41bf-b3d2-116467446979 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-7f285cb6-ac37-4d54-ac24-87effb8d557e req-bd3fdc19-b053-41bf-b3d2-116467446979 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:11 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-7f285cb6-ac37-4d54-ac24-87effb8d557e req-bd3fdc19-b053-41bf-b3d2-116467446979 tempest-TestServerVolumeAttachmentScenario-264077252 None] Terminate volume connection completed successfully.
Sep 23 15:31:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-7f285cb6-ac37-4d54-ac24-87effb8d557e req-bd3fdc19-b053-41bf-b3d2-116467446979 tempest-TestServerVolumeAttachmentScenario-264077252 None] Deleting attachment 55d69f6e-19a0-407d-a465-9b1b10d7ac3a. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:31:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "cinder-56cfd592-93e1-4e57-9a3c-59b766cf4f21-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-56cfd592-93e1-4e57-9a3c-59b766cf4f21-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "cinder-quobyte-56cfd592-93e1-4e57-9a3c-59b766cf4f21" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-quobyte-56cfd592-93e1-4e57-9a3c-59b766cf4f21" acquired by "delete_volume" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:12 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[18529e92-09f2-4cbb-9af4-6a7a5afa773a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:31:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21" returned: 0 in 0.771s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-56cfd592-93e1-4e57-9a3c-59b766cf4f21" returned: 0 in 0.245s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-quobyte-56cfd592-93e1-4e57-9a3c-59b766cf4f21" released by "delete_volume" :: held 1.288s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:13 devstack cinder-volume[84009]: WARNING cinder.quota [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56451331-301555341 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56451331-301555341, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:31:13 devstack cinder-volume[84009]: WARNING cinder.quota [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56451331-301555341 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56451331-301555341, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Created reservations ['4a095e04-ed7a-4a8b-8834-7cf70378830c', 'cb8dcbcf-7223-4bdb-b26f-ce5668b6612b', 'aa684daf-a8af-490c-b16f-9e67c31c4adf', '04cc9a19-8e83-4f01-b52f-2f51fa42657e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.156s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:14 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:31:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deleted volume successfully.
Sep 23 15:31:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c9ce9fd-94da-46b5-8fe9-6531982eff06 tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-56cfd592-93e1-4e57-9a3c-59b766cf4f21-delete_volume" released by "delete_volume" :: held 3.878s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:24 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=31,cinder:INSERT=10,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:31:25 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:31:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-81247ad9-a6b3-430d-86c6-797f08237b6a req-9aa12c66-5201-4b1c-8639-c98239cbac62 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:27 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-81247ad9-a6b3-430d-86c6-797f08237b6a req-9aa12c66-5201-4b1c-8639-c98239cbac62 tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-81247ad9-a6b3-430d-86c6-797f08237b6a req-9aa12c66-5201-4b1c-8639-c98239cbac62 tempest-TestInstancesWithCinderVolumes-1823528635 None] Terminate volume connection completed successfully.
Sep 23 15:31:27 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-81247ad9-a6b3-430d-86c6-797f08237b6a req-9aa12c66-5201-4b1c-8639-c98239cbac62 tempest-TestInstancesWithCinderVolumes-1823528635 None] Deleting attachment 044e0c1d-b60b-493b-aebe-f16b9c692310. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "cinder-8d1fd432-5621-4d33-b573-1ae4d79f4bf5-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-8d1fd432-5621-4d33-b573-1ae4d79f4bf5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:29 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "cinder-quobyte-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-quobyte-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" acquired by "delete_volume" :: waited 0.032s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43dd12b-2226-4eec-bf25-668f10696b87]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:29 devstack quobyte-client[84024]: System call of process 98673 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" returned: 0 in 0.527s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" returned: 0 in 0.147s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-quobyte-8d1fd432-5621-4d33-b573-1ae4d79f4bf5" released by "delete_volume" :: held 0.964s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Created reservations ['338b93ed-e683-4d5f-8d0a-51c7ddb80039', 'd26d990b-3b7a-4d76-b5f0-9abcbc781a1a', '466618ad-8420-4bdf-a164-c1463b34fddb', 'd55eb737-6904-4feb-9345-690687a3dff7'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.123s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:30 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:31:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Deleted volume successfully.
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-fa15f9aa-468e-4263-adf3-73e4f2b7ae67 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-8d1fd432-5621-4d33-b573-1ae4d79f4bf5-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "cinder-b2a82613-7657-4d51-ace3-742ca137b7ee-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "cinder-65453339-aaaa-4e1e-b8c6-417e810ff24e-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-b2a82613-7657-4d51-ace3-742ca137b7ee-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-65453339-aaaa-4e1e-b8c6-417e810ff24e-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "cinder-quobyte-b2a82613-7657-4d51-ace3-742ca137b7ee" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "cinder-quobyte-65453339-aaaa-4e1e-b8c6-417e810ff24e" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-quobyte-65453339-aaaa-4e1e-b8c6-417e810ff24e" acquired by "delete_volume" :: waited 0.042s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-quobyte-b2a82613-7657-4d51-ace3-742ca137b7ee" acquired by "delete_volume" :: waited 0.093s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[269d164b-8fbc-436c-b995-f1a31f4adf09]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:31:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f754e4f2-efa8-46c4-820f-edd5f396cbc0]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:31:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:32 devstack quobyte-client[84024]: System call of process 98681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:32 devstack quobyte-client[84024]: System call of process 98681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:32 devstack quobyte-client[84024]: System call of process 98681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:32 devstack quobyte-client[84024]: System call of process 98682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:32 devstack quobyte-client[84024]: System call of process 98682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 0 in 0.757s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e" returned: 0 in 1.084s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-65453339-aaaa-4e1e-b8c6-417e810ff24e" returned: 0 in 0.153s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-quobyte-65453339-aaaa-4e1e-b8c6-417e810ff24e" released by "delete_volume" :: held 1.498s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:33 devstack quobyte-client[84024]: System call of process 98686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:33 devstack quobyte-client[84024]: System call of process 98686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 1 in 0.725s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:31:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b2a82613-7657-4d51-ace3-742ca137b7ee" returned: 0 in 0.357s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-quobyte-b2a82613-7657-4d51-ace3-742ca137b7ee" released by "delete_volume" :: held 2.228s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Created reservations ['57727079-16ac-4993-a203-cb6076298d74', 'b5671893-6036-45de-96ba-5c383ad70daf', '058c134c-e613-457c-a622-56fa89d584b4', '07447aac-7575-4c34-979b-734b7fa2905e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:31:34 devstack cinder-volume[84009]: WARNING cinder.quota [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868952529-407387956 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868952529-407387956, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:31:34 devstack cinder-volume[84009]: WARNING cinder.quota [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868952529-407387956 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-868952529-407387956, it is now deprecated. Please use the default quota class for default quota.
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Created reservations ['250195d9-36b2-4ee3-b9a4-64f2fccf445d', 'd291a157-4461-4f43-9179-30e8e8aeb237', '6db4758d-7229-44f9-b3b7-a7ce621968a5', '3b75720d-640a-424d-b814-43d107cbcdb1'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.203s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:34 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:31:35 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Deleted volume successfully.
Sep 23 15:31:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:31:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:31:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:31:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:31:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.098s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:31:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:31:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-3f5587e5-d6f7-4802-b9c2-7b564329c3b1 tempest-TestServerVolumeAttachmentScenario-264077252 None] Lock "cinder-65453339-aaaa-4e1e-b8c6-417e810ff24e-delete_volume" released by "delete_volume" :: held 4.298s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.478s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:31:36 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:31:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Deleted volume successfully.
Sep 23 15:31:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-46d36f82-d497-4170-bb6b-8e446473a9ac tempest-TestInstancesWithCinderVolumes-1823528635 None] Lock "cinder-b2a82613-7657-4d51-ace3-742ca137b7ee-delete_volume" released by "delete_volume" :: held 4.665s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:31:45 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:31:46 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=17,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:32:03 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (8d0a20b4-df32-4382-8dbe-7c018a92a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4631f5-b1e5-4b0a-acc0-006706eff101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4631f5-b1e5-4b0a-acc0-006706eff101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118541762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a76d700-c26e-4681-b079-228dffc77636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:03Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745696ba-50eb-47ca-ad56-1aec073cbcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745696ba-50eb-47ca-ad56-1aec073cbcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9660d412-4b3c-42a1-864a-fec91df5b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9660d412-4b3c-42a1-864a-fec91df5b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a76d700-c26e-4681-b079-228dffc77636', 'volume_name': 'volume-2a76d700-c26e-4681-b079-228dffc77636', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6631612-62bf-4430-a6d2-6b30933a7f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6631612-62bf-4430-a6d2-6b30933a7f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83758a0-b20e-421d-b85f-9d54384a203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:03 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume 2a76d700-c26e-4681-b079-228dffc77636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a76d700-c26e-4681-b079-228dffc77636', 'volume_size': 1}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118541762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a76d700-c26e-4681-b079-228dffc77636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:03Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating volume 2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:03 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:03 devstack quobyte-client[84024]: System call of process 98740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:03 devstack quobyte-client[84024]: System call of process 98740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:03 devstack quobyte-client[84024]: System call of process 98740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:03 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=116, name=volume-2a76d700-c26e-4681-b079-228dffc77636, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 1073741824" returned: 0 in 0.410s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636" returned: 0 in 0.147s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] <== create_volume: return (654ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83758a0-b20e-421d-b85f-9d54384a203b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a76d700-c26e-4681-b079-228dffc77636', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83212751-e14b-48d5-801a-ea239077d53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:04 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume volume-2a76d700-c26e-4681-b079-228dffc77636 (2a76d700-c26e-4681-b079-228dffc77636): created successfully
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83212751-e14b-48d5-801a-ea239077d53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:04 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (8d0a20b4-df32-4382-8dbe-7c018a92a65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:04 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-51dda874-9266-426d-b354-a0578a49a1b7 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created volume successfully.
Sep 23 15:32:05 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating offline snapshot 1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 of volume 2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:32:06 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[014fea86-1dbf-4ab0-9ece-7cc5c63a2b43]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:06 devstack quobyte-client[84024]: System call of process 98744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:06 devstack quobyte-client[84024]: System call of process 98744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636" returned: 0 in 0.670s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:07 devstack quobyte-client[84024]: System call of process 98748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:07 devstack quobyte-client[84024]: System call of process 98748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:07 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=117, name=volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 1G" returned: 0 in 0.515s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2a76d700-c26e-4681-b079-228dffc77636 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:07 devstack quobyte-client[84024]: System call of process 98751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img rebase -u -b volume-2a76d700-c26e-4681-b079-228dffc77636 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" returned: 0 in 0.314s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:32:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" returned: 0 in 0.184s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" returned: 0 in 0.268s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.info" returned: 0 in 0.302s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:32:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.info" returned: 0 in 0.219s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.353s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c9bdb3b8-a4be-4510-94e5-5eea54185faa tempest-CreateVolumesFromSnapshotTest-1082274134 None] Create snapshot completed successfully
Sep 23 15:32:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (b7b41d07-9d6c-4cb5-9f64-ab16bebfe87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ec91de-d1d6-4ce3-bbc9-596c7cff8b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ec91de-d1d6-4ce3-bbc9-596c7cff8b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1596621627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd54407-f8de-4a69-adad-62774298c6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:11Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73f0dbf-1139-4caf-8189-f401c2fec30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73f0dbf-1139-4caf-8189-f401c2fec30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780bffad-0d3f-4366-91d1-ec9bdc561f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780bffad-0d3f-4366-91d1-ec9bdc561f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd54407-f8de-4a69-adad-62774298c6ab', 'volume_name': 'volume-3cd54407-f8de-4a69-adad-62774298c6ab', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbf89c1-c032-4270-a9da-2f72c313ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbf89c1-c032-4270-a9da-2f72c313ec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ab5ad0-d2b5-4998-b7b9-597397578036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume 3cd54407-f8de-4a69-adad-62774298c6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd54407-f8de-4a69-adad-62774298c6ab', 'volume_size': 1}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1596621627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd54407-f8de-4a69-adad-62774298c6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:11Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating volume 3cd54407-f8de-4a69-adad-62774298c6ab {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:11 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:12 devstack quobyte-client[84024]: System call of process 98776 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:12 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=119, name=volume-3cd54407-f8de-4a69-adad-62774298c6ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:12 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (99bd49bf-aeef-4562-b97e-ddbe78ae9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e5e2ff-dd6b-46d0-9d35-d48ea56ddf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab 1073741824" returned: 0 in 0.883s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e5e2ff-dd6b-46d0-9d35-d48ea56ddf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447162081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:12Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2836df-6142-4719-829c-7d829dd60b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2836df-6142-4719-829c-7d829dd60b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eab1309-d635-470f-890f-0ba3888065dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eab1309-d635-470f-890f-0ba3888065dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9', 'volume_name': 'volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1388f9-1e42-41e0-b8ca-bbf1b712fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1388f9-1e42-41e0-b8ca-bbf1b712fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3902d02f-4f48-46e3-be5d-5ff8e5cf8772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume 1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9', 'volume_size': 1}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:13 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (4238eadd-cfd3-4e7b-a26c-879b5ac20f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ab965-e0ea-49d3-8d8b-887745987381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab" returned: 0 in 1.282s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] <== create_volume: return (2271ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447162081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:12Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating volume 1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:14 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:14 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=120, name=volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ab965-e0ea-49d3-8d8b-887745987381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992217160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7cb08c-0c69-4a8c-aea9-fe5838ee3881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:13Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244df369-7e40-493e-acc1-289431ab7299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244df369-7e40-493e-acc1-289431ab7299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b54cdaf-0d7c-4848-8471-1b25ee9d54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b54cdaf-0d7c-4848-8471-1b25ee9d54c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7cb08c-0c69-4a8c-aea9-fe5838ee3881', 'volume_name': 'volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4b391f-70f0-4895-a05d-3edadfcd52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4b391f-70f0-4895-a05d-3edadfcd52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b30614-5e0f-4797-940a-ac4a7758254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume 5b7cb08c-0c69-4a8c-aea9-fe5838ee3881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881', 'volume_size': 1}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (9f1a1940-16be-4047-8ec2-5e87d4fc1459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffe56e3-6f98-4ab4-98b7-3290dd9ddb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (b8b41285-2343-4f0f-90dc-9ca54531d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6aed4b-2d53-4182-a5d7-9cf35b275dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffe56e3-6f98-4ab4-98b7-3290dd9ddb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758913658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7509cf0c-d643-481e-acfd-6bdc2a851be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:14Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14ce09a-7c29-48ca-b18c-e8fda5aa2cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14ce09a-7c29-48ca-b18c-e8fda5aa2cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f28eccd-087d-408a-874f-7f3438815372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f28eccd-087d-408a-874f-7f3438815372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7509cf0c-d643-481e-acfd-6bdc2a851be3', 'volume_name': 'volume-7509cf0c-d643-481e-acfd-6bdc2a851be3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e449ff7-3d8e-41bb-a545-7269ce2a695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e449ff7-3d8e-41bb-a545-7269ce2a695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d74030-4a28-4693-9440-409a9970f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume 7509cf0c-d643-481e-acfd-6bdc2a851be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7509cf0c-d643-481e-acfd-6bdc2a851be3', 'volume_size': 1}
Sep 23 15:32:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6aed4b-2d53-4182-a5d7-9cf35b275dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354212933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b105f349-c467-45e6-9bf0-5d3802e3a5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:13Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932aed5e-20a6-4e47-81a3-a239d2d31900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932aed5e-20a6-4e47-81a3-a239d2d31900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23888dc-840f-4dec-a939-5efa96412062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23888dc-840f-4dec-a939-5efa96412062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b105f349-c467-45e6-9bf0-5d3802e3a5f6', 'volume_name': 'volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886c4916-c441-4c85-9f6d-290525f2229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886c4916-c441-4c85-9f6d-290525f2229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9985ea4c-392c-479f-ac94-a39482d070ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume b105f349-c467-45e6-9bf0-5d3802e3a5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6', 'volume_size': 1}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ab5ad0-d2b5-4998-b7b9-597397578036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd54407-f8de-4a69-adad-62774298c6ab', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179c3d18-6bd4-4ffc-848b-979f5ee3aec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 1073741824" returned: 0 in 0.981s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume volume-3cd54407-f8de-4a69-adad-62774298c6ab (3cd54407-f8de-4a69-adad-62774298c6ab): created successfully
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179c3d18-6bd4-4ffc-848b-979f5ee3aec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (b7b41d07-9d6c-4cb5-9f64-ab16bebfe87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9" returned: 0 in 0.650s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] <== create_volume: return (1656ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992217160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7cb08c-0c69-4a8c-aea9-fe5838ee3881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:13Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating volume 5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:15 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:15 devstack quobyte-client[84024]: System call of process 98787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:16 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=121, name=volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-05897b35-c211-4848-9978-082e5abba9ff tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created volume successfully.
Sep 23 15:32:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3902d02f-4f48-46e3-be5d-5ff8e5cf8772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dffc05-9fa5-4cec-8116-55da950607ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 1073741824" returned: 0 in 0.717s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 (1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9): created successfully
Sep 23 15:32:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dffc05-9fa5-4cec-8116-55da950607ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (99bd49bf-aeef-4562-b97e-ddbe78ae9b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:17 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9568093c-628f-4702-8c11-73216d24788d tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created volume successfully.
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881" returned: 0 in 0.531s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] <== create_volume: return (1287ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.095s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758913658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7509cf0c-d643-481e-acfd-6bdc2a851be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:14Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating volume 7509cf0c-d643-481e-acfd-6bdc2a851be3 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:17 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:17 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=122, name=volume-7509cf0c-d643-481e-acfd-6bdc2a851be3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b30614-5e0f-4797-940a-ac4a7758254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76907533-49d0-4b3c-8a30-37920c3bd625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:17 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 (5b7cb08c-0c69-4a8c-aea9-fe5838ee3881): created successfully
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76907533-49d0-4b3c-8a30-37920c3bd625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (4238eadd-cfd3-4e7b-a26c-879b5ac20f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3 1073741824" returned: 0 in 0.824s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c782834e-1c10-45f6-b6ad-dc9aa93408d0 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created volume successfully.
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3" returned: 0 in 0.664s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] <== create_volume: return (1576ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.766s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354212933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b105f349-c467-45e6-9bf0-5d3802e3a5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af74a8d80e949e18064d249c5de922d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:13Z,use_quota=True,user_id='10f9dcd98dbc4c1f9092ad68678aad84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Creating volume b105f349-c467-45e6-9bf0-5d3802e3a5f6 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:18 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:19 devstack quobyte-client[84024]: System call of process 98804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:19 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=123, name=volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:32:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d74030-4a28-4693-9440-409a9970f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7509cf0c-d643-481e-acfd-6bdc2a851be3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc8b7db-7b28-49ec-a219-d963086b5cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:19 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume volume-7509cf0c-d643-481e-acfd-6bdc2a851be3 (7509cf0c-d643-481e-acfd-6bdc2a851be3): created successfully
Sep 23 15:32:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc8b7db-7b28-49ec-a219-d963086b5cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (9f1a1940-16be-4047-8ec2-5e87d4fc1459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:19 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9cd67124-3b88-49af-be7a-bb1a4310b524 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created volume successfully.
Sep 23 15:32:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6 1073741824" returned: 0 in 0.953s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6" returned: 0 in 0.292s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] <== create_volume: return (1387ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:32:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9985ea4c-392c-479f-ac94-a39482d070ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bf7d0b-c4cf-446a-8c15-6cca5d3e611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:20 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6 (b105f349-c467-45e6-9bf0-5d3802e3a5f6): created successfully
Sep 23 15:32:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bf7d0b-c4cf-446a-8c15-6cca5d3e611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Flow 'volume_create_manager' (b8b41285-2343-4f0f-90dc-9ca54531d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-bbe46e91-8a59-4ea0-8144-c02885c94bb5 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created volume successfully.
Sep 23 15:32:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-7509cf0c-d643-481e-acfd-6bdc2a851be3-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-7509cf0c-d643-481e-acfd-6bdc2a851be3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:23 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-7509cf0c-d643-481e-acfd-6bdc2a851be3" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-7509cf0c-d643-481e-acfd-6bdc2a851be3" acquired by "delete_volume" :: waited 0.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d6b444-a0fa-471f-9867-9005d0322853]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:24 devstack quobyte-client[84024]: System call of process 98863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:24 devstack quobyte-client[84024]: System call of process 98863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:24 devstack quobyte-client[84024]: System call of process 98863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:24 devstack quobyte-client[84024]: System call of process 98863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3" returned: 0 in 1.472s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7509cf0c-d643-481e-acfd-6bdc2a851be3" returned: 0 in 0.265s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-7509cf0c-d643-481e-acfd-6bdc2a851be3" released by "delete_volume" :: held 2.182s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['e4f195f9-28f0-4bb9-8acd-f645b25f8de4', '1baaba59-35bc-42c1-8f87-37aeab3df45f', 'c50b46c7-8f5c-47c0-84b5-d98926aed800', '07ec808a-3f16-47a1-88cf-08e8a94dab0a'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-b105f349-c467-45e6-9bf0-5d3802e3a5f6-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.438s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:27 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-b105f349-c467-45e6-9bf0-5d3802e3a5f6-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:27 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleted volume successfully.
Sep 23 15:32:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-452d846e-2293-4571-a9b8-d6d199b77424 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-7509cf0c-d643-481e-acfd-6bdc2a851be3-delete_volume" released by "delete_volume" :: held 4.687s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:28 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-b105f349-c467-45e6-9bf0-5d3802e3a5f6" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-b105f349-c467-45e6-9bf0-5d3802e3a5f6" acquired by "delete_volume" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:28 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc92827a-485b-4980-8016-eb8213c5f94d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6" returned: 0 in 0.817s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b105f349-c467-45e6-9bf0-5d3802e3a5f6" returned: 0 in 0.316s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-b105f349-c467-45e6-9bf0-5d3802e3a5f6" released by "delete_volume" :: held 1.569s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['352cfe7f-b67a-40ff-8fdf-bbd60de93b3b', 'ba9b8fe4-e08b-43ce-b35e-9983e35af580', '913cc13c-9660-4693-a68b-8173be3c08fe', '1c987f0f-7271-49e3-95eb-ac133db4a55c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.180s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:30 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:31 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleted volume successfully.
Sep 23 15:32:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d44ea872-180c-410e-b240-c41d97a5f478 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-b105f349-c467-45e6-9bf0-5d3802e3a5f6-delete_volume" released by "delete_volume" :: held 4.407s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:32 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d365b0-30d2-4bc4-91ec-f23c740543e7]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:33 devstack quobyte-client[84024]: System call of process 98894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:33 devstack quobyte-client[84024]: System call of process 98894 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881" returned: 0 in 1.377s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881" returned: 0 in 0.272s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881" released by "delete_volume" :: held 2.225s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:34 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['03a4bea6-2148-494a-a327-feaa66bc83ac', 'fe2ea013-1fb3-43cb-a511-cd788a1cf036', '2532824a-0f7f-4ace-9854-f98b0043c22f', 'b4de44a4-7e3e-46cc-bbeb-2b975f61caf1'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.162s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:35 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:35 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleted volume successfully.
Sep 23 15:32:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9-delete_volume" acquired by "delete_volume" :: waited 0.231s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a3cb9a42-9e3f-479d-8b3c-8e4b95721afc tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-5b7cb08c-0c69-4a8c-aea9-fe5838ee3881-delete_volume" released by "delete_volume" :: held 4.757s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9" acquired by "delete_volume" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fded83-7c46-45bb-8959-e75381f75683]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:38 devstack quobyte-client[84024]: System call of process 98901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:38 devstack quobyte-client[84024]: System call of process 98901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:38 devstack quobyte-client[84024]: System call of process 98901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9" returned: 0 in 1.288s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9" returned: 0 in 0.566s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9" released by "delete_volume" :: held 2.616s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['8249e731-6051-4081-a2b9-d821cb169b5d', '448aafa5-935f-4bbc-9349-4d3156a69820', '2284e534-9baa-4720-a10c-bccd08779f1b', 'd50fd145-7bc1-4fac-abaa-b868b67ee7ab'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.229s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:41 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleted volume successfully.
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7be28d92-b0e4-4ed7-9439-6ce244416d15 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-1bfc3e29-9e8c-4aa8-bb89-98ecb25eafa9-delete_volume" released by "delete_volume" :: held 5.478s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-3cd54407-f8de-4a69-adad-62774298c6ab-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-3cd54407-f8de-4a69-adad-62774298c6ab-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-3cd54407-f8de-4a69-adad-62774298c6ab" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-3cd54407-f8de-4a69-adad-62774298c6ab" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed5ba9-9366-4b04-949a-793e0a0f466f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:43 devstack quobyte-client[84024]: System call of process 98940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:43 devstack quobyte-client[84024]: System call of process 98940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:43 devstack quobyte-client[84024]: System call of process 98940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab" returned: 0 in 1.154s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3cd54407-f8de-4a69-adad-62774298c6ab" returned: 0 in 0.374s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-3cd54407-f8de-4a69-adad-62774298c6ab" released by "delete_volume" :: held 1.998s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['0f6cadb8-df1f-4ea0-b4ab-89e48a0e5065', '84be1a00-5952-4d8b-8e23-4fb543430917', '2db206a1-16fa-4b48-92e4-67377084288f', 'd7b2ee19-ecff-4f29-a596-4b7ecf2604d6'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.319s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:46 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:47 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleted volume successfully.
Sep 23 15:32:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c7a9a7da-dcae-4695-97d0-0d0183ca7c0b tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-3cd54407-f8de-4a69-adad-62774298c6ab-delete_volume" released by "delete_volume" :: held 5.113s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:47 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-2a76d700-c26e-4681-b079-228dffc77636" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-2a76d700-c26e-4681-b079-228dffc77636" acquired by "delete_snapshot" :: waited 0.055s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleting offline snapshot 1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 of volume 2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] snapshot_file for this snap is: volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[307fc5f6-acab-4920-8dab-c30cf32ba811]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:49 devstack quobyte-client[84024]: System call of process 98955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:49 devstack quobyte-client[84024]: System call of process 98955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" returned: 0 in 0.848s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a76d700-c26e-4681-b079-228dffc77636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:32:49 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[979970b8-8bc5-4fff-bac8-60b2fc7d28ef]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:49 devstack quobyte-client[84024]: System call of process 98958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636" returned: 0 in 0.791s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" returned: 0 in 0.512s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636.1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" returned: 0 in 0.210s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817" released by "_delete_snapshot" :: held 3.090s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-2a76d700-c26e-4681-b079-228dffc77636" released by "delete_snapshot" :: held 3.182s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:51 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['f60a4be5-a4a5-4e55-a6fe-fca595d641ba', '92b3dd41-5d64-4477-84c9-dcf4baf7c62b', '69689d05-6891-4d92-be39-49592e9f6ca1', 'cc74b84c-99e1-4837-9339-75cf0d7ca799'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:51 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Delete snapshot completed successfully.
Sep 23 15:32:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-881bec50-36c7-4ff5-9700-e56c41130cd4 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-1f6c3f7d-cf9c-456a-ac41-2bcba4b6e817-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-2a76d700-c26e-4681-b079-228dffc77636-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-2a76d700-c26e-4681-b079-228dffc77636-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "cinder-quobyte-2a76d700-c26e-4681-b079-228dffc77636" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:32:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-2a76d700-c26e-4681-b079-228dffc77636" acquired by "delete_volume" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:32:52 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee3bf4-db4a-4450-a925-6541ca848d57]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:53 devstack quobyte-client[84024]: System call of process 98965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:53 devstack quobyte-client[84024]: System call of process 98965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:53 devstack quobyte-client[84024]: System call of process 98965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:32:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636" returned: 0 in 0.676s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a76d700-c26e-4681-b079-228dffc77636" returned: 0 in 0.266s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-quobyte-2a76d700-c26e-4681-b079-228dffc77636" released by "delete_volume" :: held 1.288s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Created reservations ['f2871a4b-0782-4fa1-a409-ff2839560a34', '84660a16-ddc0-4f1a-9846-4c1f3cde16b5', 'bd0c0865-faab-40fa-a24b-473055f2eaf7', '935eb6da-4f54-445f-ab40-d31902cd2ebe'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.148s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:32:54 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Deleted volume successfully.
Sep 23 15:32:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-bba97813-6c97-46c8-8ceb-a9bdac72d161 tempest-CreateVolumesFromSnapshotTest-1082274134 None] Lock "cinder-2a76d700-c26e-4681-b079-228dffc77636-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:32:55 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=43,cinder:UPDATE=58,cinder:DELETE=8,cinder:INSERT=16 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:32:56 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Flow 'volume_create_manager' (2e1fa90a-e284-4788-9686-f1e4b5bf1f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a34b7c-fad0-4925-9a3b-5243be972dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a34b7c-fad0-4925-9a3b-5243be972dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1321891667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d404f-077c-4d89-810d-09ac13365914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef747a9d2ac54daa8394f26d8ed9a414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:56Z,use_quota=True,user_id='9f3e8203794c4466add9665fae8b5b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc8a74e-479a-429f-92c3-131e1541cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc8a74e-479a-429f-92c3-131e1541cc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909f0bc3-74a8-43c0-bc2c-6c35c0f35a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909f0bc3-74a8-43c0-bc2c-6c35c0f35a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f70d404f-077c-4d89-810d-09ac13365914', 'volume_name': 'volume-f70d404f-077c-4d89-810d-09ac13365914', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728e82170>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abc8b2b-a44c-41a6-ad97-8a74cb04a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abc8b2b-a44c-41a6-ad97-8a74cb04a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005a41b4-de08-4548-961c-cd1d4200f84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:56 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Volume f70d404f-077c-4d89-810d-09ac13365914: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f70d404f-077c-4d89-810d-09ac13365914', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728e82170>}
Sep 23 15:32:56 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Cloning f70d404f-077c-4d89-810d-09ac13365914 from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3  at location (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:32:57 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:32:57 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Image download 20.69 MB at 20.69 MB/s
Sep 23 15:32:57 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7737553c-fcad-4c15-abe6-4a80cc4e3f77]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:32:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:32:58 devstack sudo[98972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD
Sep 23 15:32:58 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=44,cinder:UPDATE=78,cinder:DELETE=5,cinder:INSERT=12 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:32:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Flow 'volume_create_manager' (86b9b2db-590c-47a3-b9f9-a025c0e319de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0a018f-fac4-4817-83a6-dc04bfa5bb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0a018f-fac4-4817-83a6-dc04bfa5bb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2173cf01-3583-4cd1-a8a2-50e4d4dc73da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45abca4e8bc4b918db33673ee7e369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:59Z,use_quota=True,user_id='f1adf4ce3a5f4abba70b64d4b2620435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebef19e7-bf2c-4f6e-a2a8-f6ce24caf45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebef19e7-bf2c-4f6e-a2a8-f6ce24caf45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d0dfcd-58bb-4c4e-93ff-acb8ec284794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d0dfcd-58bb-4c4e-93ff-acb8ec284794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2173cf01-3583-4cd1-a8a2-50e4d4dc73da', 'volume_name': 'volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a64c560-2f95-4bc1-8eb4-3fab2733ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a64c560-2f95-4bc1-8eb4-3fab2733ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31c4fca-f767-4d87-92cf-43cfeda5b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:32:59 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Volume 2173cf01-3583-4cd1-a8a2-50e4d4dc73da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da', 'volume_size': 1}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2173cf01-3583-4cd1-a8a2-50e4d4dc73da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45abca4e8bc4b918db33673ee7e369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:59Z,use_quota=True,user_id='f1adf4ce3a5f4abba70b64d4b2620435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Creating volume 2173cf01-3583-4cd1-a8a2-50e4d4dc73da {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:32:59 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:32:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:00 devstack quobyte-client[84024]: System call of process 98994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:00 devstack quobyte-client[84024]: System call of process 98994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:00 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=124, name=volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:33:00 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD" returned: 0 in 2.760s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 is fetched for user 9f3e8203794c4466add9665fae8b5b45. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da 1073741824" returned: 0 in 0.672s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da" returned: 0 in 0.201s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:33:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31c4fca-f767-4d87-92cf-43cfeda5b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866f5187-2ab7-4af3-8fcd-a85963e4e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:01 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Volume volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da (2173cf01-3583-4cd1-a8a2-50e4d4dc73da): created successfully
Sep 23 15:33:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866f5187-2ab7-4af3-8fcd-a85963e4e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Flow 'volume_create_manager' (86b9b2db-590c-47a3-b9f9-a025c0e319de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:33:01 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7bf8d5-a1ee-4711-a5f9-0c5cb39e4d0b]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-36d8db85-40b7-4a4d-bff7-6a0f5ce5c6bb tempest-CinderUnicodeTest-1261108967 None] Created volume successfully.
Sep 23 15:33:02 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD
Sep 23 15:33:02 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:33:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Flow 'volume_create_manager' (20bb6044-743b-4d67-a7f2-20b71f3dfa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bda3d3-0e6b-41c0-b042-1544a15a3228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bda3d3-0e6b-41c0-b042-1544a15a3228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:33:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-149264537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456528cd-7cd0-4eed-9947-7186c2d6b798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45abca4e8bc4b918db33673ee7e369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:33:02Z,use_quota=True,user_id='f1adf4ce3a5f4abba70b64d4b2620435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a86260-3606-4081-af05-347ecea047c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a86260-3606-4081-af05-347ecea047c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82772ad8-90be-4ed2-8d22-779ade6acb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82772ad8-90be-4ed2-8d22-779ade6acb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456528cd-7cd0-4eed-9947-7186c2d6b798', 'volume_name': 'volume-456528cd-7cd0-4eed-9947-7186c2d6b798', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc149054-b465-48fc-9f67-3c9ef45f83cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc149054-b465-48fc-9f67-3c9ef45f83cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfe4268-e9e9-4d95-a714-6b61d0dc0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:02 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Volume 456528cd-7cd0-4eed-9947-7186c2d6b798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456528cd-7cd0-4eed-9947-7186c2d6b798', 'volume_size': 1}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:33:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-149264537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456528cd-7cd0-4eed-9947-7186c2d6b798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f45abca4e8bc4b918db33673ee7e369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:33:02Z,use_quota=True,user_id='f1adf4ce3a5f4abba70b64d4b2620435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Creating volume 456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:33:02 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:33:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:02 devstack quobyte-client[84024]: System call of process 99000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:02 devstack quobyte-client[84024]: System call of process 99000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:02 devstack quobyte-client[84024]: System call of process 99000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:02 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=125, name=volume-456528cd-7cd0-4eed-9947-7186c2d6b798, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 1073741824" returned: 0 in 0.432s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798" returned: 0 in 0.152s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfe4268-e9e9-4d95-a714-6b61d0dc0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456528cd-7cd0-4eed-9947-7186c2d6b798', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f966f0f-f49e-4d8f-923b-81e0e8a7c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:03 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Volume volume-456528cd-7cd0-4eed-9947-7186c2d6b798 (456528cd-7cd0-4eed-9947-7186c2d6b798): created successfully
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f966f0f-f49e-4d8f-923b-81e0e8a7c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Flow 'volume_create_manager' (20bb6044-743b-4d67-a7f2-20b71f3dfa16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:33:03 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-29983ab8-f80f-4161-a549-4605c2d7138a tempest-CinderUnicodeTest-1261108967 None] Created volume successfully.
Sep 23 15:33:04 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD" returned: 0 in 3.533s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1321891667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70d404f-077c-4d89-810d-09ac13365914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef747a9d2ac54daa8394f26d8ed9a414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:32:56Z,use_quota=True,user_id='9f3e8203794c4466add9665fae8b5b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Creating volume f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:33:04 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:33:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:05 devstack quobyte-client[84024]: System call of process 99007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:05 devstack quobyte-client[84024]: System call of process 99007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:05 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=126, name=volume-f70d404f-077c-4d89-810d-09ac13365914, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 1073741824" returned: 0 in 0.492s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:05 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 0.200s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.163s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Creating offline snapshot 0384fa8e-8eac-41d3-9e4d-3645ac7a6304 of volume 456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Attempting download of 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume f70d404f-077c-4d89-810d-09ac13365914. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7aaa2-26e4-48e0-97ec-67fff733298b]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:06 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[162664d1-81b0-47d4-a731-fe70ce806eaa]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_c7q994ug {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:06 devstack quobyte-client[84024]: System call of process 99011 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798" returned: 0 in 0.621s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:06 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=127, name=volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:33:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_c7q994ug" returned: 0 in 0.708s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_c7q994ug {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 1G" returned: 0 in 0.553s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): qemu-img rebase -u -b volume-456528cd-7cd0-4eed-9947-7186c2d6b798 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:07 devstack quobyte-client[84024]: System call of process 99020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "qemu-img rebase -u -b volume-456528cd-7cd0-4eed-9947-7186c2d6b798 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304" returned: 0 in 0.271s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_c7q994ug" returned: 1 in 0.600s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26f34a6e-cf6d-4d01-b96a-d62e819357f3_c7q994ug' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dd5341-c761-4312-80c5-4a0c13511ea3]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304" returned: 0 in 0.235s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:33:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304" returned: 0 in 0.226s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] 26f34a6e-cf6d-4d01-b96a-d62e819357f3 was qcow2, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.info" returned: 0 in 0.293s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:08 devstack quobyte-client[84024]: System call of process 99032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:08 devstack quobyte-client[84024]: System call of process 99032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:08 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=126, name=volume-f70d404f-077c-4d89-810d-09ac13365914, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.info" returned: 0 in 0.150s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:09 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b9bd1c5b-4919-4cbe-93c8-a7e05ff61fbf tempest-CinderUnicodeTest-1261108967 None] Create snapshot completed successfully
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 1.357s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26f34a6e-cf6d-4d01-b96a-d62e819357f3_8uwxzii0devstack@QuobyteHD, size 112.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:33:09 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Converted 112.00 MB image at 79.98 MB/s
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.236s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:33:09 devstack quobyte-client[84024]: System call of process 99043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 1G" returned: 0 in 0.227s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[21455de1-1333-4e37-8893-1b037357dab7]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-0384fa8e-8eac-41d3-9e4d-3645ac7a6304-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-0384fa8e-8eac-41d3-9e4d-3645ac7a6304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.130s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:10 devstack quobyte-client[84024]: System call of process 99046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:10 devstack quobyte-client[84024]: System call of process 99046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:10 devstack quobyte-client[84024]: System call of process 99046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:10 devstack quobyte-client[84024]: System call of process 99046 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-quobyte-456528cd-7cd0-4eed-9947-7186c2d6b798" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-456528cd-7cd0-4eed-9947-7186c2d6b798" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-quobyte-0384fa8e-8eac-41d3-9e4d-3645ac7a6304" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 0.768s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-0384fa8e-8eac-41d3-9e4d-3645ac7a6304" acquired by "_delete_snapshot" :: waited 0.243s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Deleting offline snapshot 0384fa8e-8eac-41d3-9e4d-3645ac7a6304 of volume 456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] snapshot_file for this snap is: volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c36b07e-dcb4-4cf8-a2e0-c335c4413d7b]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:11 devstack quobyte-client[84024]: System call of process 99048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 1 in 0.571s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Downloaded image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}])) to volume f70d404f-077c-4d89-810d-09ac13365914 successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Temporary image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 for user 9f3e8203794c4466add9665fae8b5b45 is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Marking volume f70d404f-077c-4d89-810d-09ac13365914 as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Copying metadata from image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 to f70d404f-077c-4d89-810d-09ac13365914. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Creating volume glance metadata for volume f70d404f-077c-4d89-810d-09ac13365914 backed by image 26f34a6e-cf6d-4d01-b96a-d62e819357f3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:33:11 devstack quobyte-client[84024]: System call of process 99049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304" returned: 0 in 0.708s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456528cd-7cd0-4eed-9947-7186c2d6b798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1bd3f6-9bb9-44f0-ae5d-ace728dfc4f2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005a41b4-de08-4548-961c-cd1d4200f84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70d404f-077c-4d89-810d-09ac13365914', 'volume_size': 1, 'image_id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9b40561969794bb2845035c717cc19b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26f34a6e-cf6d-4d01-b96a-d62e819357f3', 'created_at': datetime.datetime(2025, 9, 23, 12, 51, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 12, 51, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26f34a6e-cf6d-4d01-b96a-d62e819357f3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9728e82170>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f8e8a5-0200-4a57-81e2-a69055617aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Volume volume-f70d404f-077c-4d89-810d-09ac13365914 (f70d404f-077c-4d89-810d-09ac13365914): created successfully
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f8e8a5-0200-4a57-81e2-a69055617aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Flow 'volume_create_manager' (2e1fa90a-e284-4788-9686-f1e4b5bf1f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:33:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5572099b-d2b0-4000-8c4a-687705818967 tempest-TestShelveInstance-1549211440 None] Created volume successfully.
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798" returned: 0 in 0.646s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:12 devstack quobyte-client[84024]: System call of process 99057 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304" returned: 0 in 0.307s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798.0384fa8e-8eac-41d3-9e4d-3645ac7a6304" returned: 0 in 0.120s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-0384fa8e-8eac-41d3-9e4d-3645ac7a6304" released by "_delete_snapshot" :: held 2.189s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-456528cd-7cd0-4eed-9947-7186c2d6b798" released by "delete_snapshot" :: held 2.449s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:13 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Created reservations ['b1e8bd58-859c-42f8-9f9d-ceb8c47f702c', '2148f0df-6ca9-40e0-9cc2-28af2c71f3a7', 'a6120637-3de8-4356-a2f7-5097cca3ed4c', 'b0eea39d-0326-46ea-8845-a0a2064b2737'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:33:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Delete snapshot completed successfully.
Sep 23 15:33:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7bba877d-ff76-4257-8156-1c9f827ad4a8 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-0384fa8e-8eac-41d3-9e4d-3645ac7a6304-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-456528cd-7cd0-4eed-9947-7186c2d6b798-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-456528cd-7cd0-4eed-9947-7186c2d6b798-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-quobyte-456528cd-7cd0-4eed-9947-7186c2d6b798" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-456528cd-7cd0-4eed-9947-7186c2d6b798" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bb68ac-368a-4e15-81b3-bada742eaa03]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798" returned: 0 in 0.509s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-456528cd-7cd0-4eed-9947-7186c2d6b798" returned: 0 in 0.100s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-456528cd-7cd0-4eed-9947-7186c2d6b798" released by "delete_volume" :: held 0.817s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Created reservations ['32e505ce-2971-4a90-895e-bb34aa8de016', '6c0d8a68-d85a-44d5-b7d1-746df5afc7c6', '58d0df87-252b-4b60-870e-62f23450545f', '3758b792-0f9e-4da0-9ab9-660456dd3afd'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.126s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:33:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Deleted volume successfully.
Sep 23 15:33:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eabc343b-d148-45f0-9e63-ee9f018dde8c tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-456528cd-7cd0-4eed-9947-7186c2d6b798-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-2173cf01-3583-4cd1-a8a2-50e4d4dc73da-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-2173cf01-3583-4cd1-a8a2-50e4d4dc73da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "cinder-quobyte-2173cf01-3583-4cd1-a8a2-50e4d4dc73da" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-2173cf01-3583-4cd1-a8a2-50e4d4dc73da" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae6926a-2729-46f1-8cfc-d0395408fba0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da" returned: 0 in 0.481s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2173cf01-3583-4cd1-a8a2-50e4d4dc73da" returned: 0 in 0.099s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-quobyte-2173cf01-3583-4cd1-a8a2-50e4d4dc73da" released by "delete_volume" :: held 0.751s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Created reservations ['685d0e23-a409-47a4-a241-f1401470ea27', '7d745966-4c04-4282-8d87-838626d790ae', '8e3352f8-4729-4e25-b141-ce110bacc72e', '2ce7bd88-f1aa-417b-9637-040fab48f206'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.107s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:18 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:33:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Deleted volume successfully.
Sep 23 15:33:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-721952b2-2207-43c9-82af-88a71326e018 tempest-CinderUnicodeTest-1261108967 None] Lock "cinder-2173cf01-3583-4cd1-a8a2-50e4d4dc73da-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:33:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:23 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9941bb-e7e6-4811-afcf-615f866f2a87]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:23 devstack quobyte-client[84024]: System call of process 99082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 0.646s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:24 devstack quobyte-client[84024]: System call of process 99085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:24 devstack quobyte-client[84024]: System call of process 99085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 1 in 0.678s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:33:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.570s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:24 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-f70d404f-077c-4d89-810d-09ac13365914', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b2fb56e-a0ed-4bcb-b235-9ba25990c5e4', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:33:24 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:25 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-86c579fc-75ac-4ac3-bd69-36b1fbcc1de9 req-695b3469-47b5-4433-961a-7a77edaac084 tempest-TestShelveInstance-1549211440 None] attachment_update completed successfully.
Sep 23 15:33:35 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=26,cinder:SELECT=27,cinder:INSERT=3,cinder:DELETE=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:33:35 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=35,cinder:DELETE=4,cinder:UPDATE=35,cinder:INSERT=22 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:33:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Flow 'volume_create_manager' (c7f1ecde-2eed-45b6-a3a2-54aaf3e1e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4c60af-9dbf-4995-aacc-78ea3d110f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4c60af-9dbf-4995-aacc-78ea3d110f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-143860167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f31069-e671-42c0-9171-280b815e7b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be30fb0978244529add5030316c0cbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:33:42Z,use_quota=True,user_id='25489392fbb8496184d03a80e81078d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5327a426-7546-4160-bad3-1899222690ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5327a426-7546-4160-bad3-1899222690ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ed5cfd-ce2f-4466-a93e-d3e12d517c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ed5cfd-ce2f-4466-a93e-d3e12d517c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f31069-e671-42c0-9171-280b815e7b60', 'volume_name': 'volume-51f31069-e671-42c0-9171-280b815e7b60', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3edcc2-fa39-4c03-bc9d-984cbef46121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af3edcc2-fa39-4c03-bc9d-984cbef46121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff214c2-39e5-4231-b246-351c7441a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:42 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume 51f31069-e671-42c0-9171-280b815e7b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f31069-e671-42c0-9171-280b815e7b60', 'volume_size': 1}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-143860167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f31069-e671-42c0-9171-280b815e7b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be30fb0978244529add5030316c0cbe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:33:42Z,use_quota=True,user_id='25489392fbb8496184d03a80e81078d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Creating volume 51f31069-e671-42c0-9171-280b815e7b60 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:33:42 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:33:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:43 devstack quobyte-client[84024]: System call of process 99604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:43 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=129, name=volume-51f31069-e671-42c0-9171-280b815e7b60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:33:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60 1073741824" returned: 0 in 0.881s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60" returned: 0 in 0.657s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] <== create_volume: return (1824ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:33:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff214c2-39e5-4231-b246-351c7441a6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f31069-e671-42c0-9171-280b815e7b60', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80ee045-124d-465c-a5b8-74f61d8409d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:33:45 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume volume-51f31069-e671-42c0-9171-280b815e7b60 (51f31069-e671-42c0-9171-280b815e7b60): created successfully
Sep 23 15:33:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80ee045-124d-465c-a5b8-74f61d8409d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:33:45 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Flow 'volume_create_manager' (c7f1ecde-2eed-45b6-a3a2-54aaf3e1e185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:33:45 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e80d4d55-f852-473f-837e-427ba9f18a04 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Created volume successfully.
Sep 23 15:33:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:33:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:33:51 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e56a26a-8a65-464d-a5c7-46ff8499c2d7]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:33:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:33:52 devstack quobyte-client[84024]: System call of process 99653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:33:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60" returned: 0 in 0.660s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:33:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:33:52 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-51f31069-e671-42c0-9171-280b815e7b60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14865bb9-0fa6-429d-97a0-9e6c404f8409', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:33:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:33:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-198093de-cfbc-42b5-ace0-1335709e4985 req-4003f774-1568-4649-ae99-7117eac058c3 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] attachment_update completed successfully.
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.147s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:34:12 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:34:13 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:34:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-66d825eb-072b-4daa-907a-0a70855b6770 req-50d9a0bc-2095-410c-887a-99303711ca7e tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:21 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-66d825eb-072b-4daa-907a-0a70855b6770 req-50d9a0bc-2095-410c-887a-99303711ca7e tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-66d825eb-072b-4daa-907a-0a70855b6770 req-50d9a0bc-2095-410c-887a-99303711ca7e tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Terminate volume connection completed successfully.
Sep 23 15:34:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-66d825eb-072b-4daa-907a-0a70855b6770 req-50d9a0bc-2095-410c-887a-99303711ca7e tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Deleting attachment 14865bb9-0fa6-429d-97a0-9e6c404f8409. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:34:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Acquiring lock "cinder-51f31069-e671-42c0-9171-280b815e7b60-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:34:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "cinder-51f31069-e671-42c0-9171-280b815e7b60-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:34:22 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Acquiring lock "cinder-quobyte-51f31069-e671-42c0-9171-280b815e7b60" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:34:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "cinder-quobyte-51f31069-e671-42c0-9171-280b815e7b60" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:34:22 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac3d09-d863-480b-bbd6-00a25fadba0c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:34:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:23 devstack quobyte-client[84024]: System call of process 99691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:34:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60" returned: 0 in 0.428s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-51f31069-e671-42c0-9171-280b815e7b60" returned: 0 in 0.112s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "cinder-quobyte-51f31069-e671-42c0-9171-280b815e7b60" released by "delete_volume" :: held 0.718s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:34:23 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Created reservations ['199c3760-b4b0-4908-8580-c3d2960b1119', '199cbcf3-3eff-4d62-85e5-8abb7ac29ca7', '9f0b44ae-e9e0-4c68-8506-d843e8b5f18d', '8371087a-d3f4-4b0d-9302-12954aac38a5'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.088s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:34:24 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Deleted volume successfully.
Sep 23 15:34:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ff6ec079-4fb0-485a-afa6-d1a7a3166357 tempest-TestServerVolumeAttachScenarioOldVersion-1610502207 None] Lock "cinder-51f31069-e671-42c0-9171-280b815e7b60-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:34:34 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=13 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:34:34 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:34:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (dd1f9cf6-0af2-43c6-8fb9-e318698efec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2c755-9035-4b51-8b84-1193f7dcb0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea2c755-9035-4b51-8b84-1193f7dcb0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-620317918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09342b7d-02e6-440c-8f2c-449f0acd2c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:53Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10c3761-41e9-4f47-987f-72a17d10e6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10c3761-41e9-4f47-987f-72a17d10e6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0229b93-881c-4679-9ca4-a578f27e4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0229b93-881c-4679-9ca4-a578f27e4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09342b7d-02e6-440c-8f2c-449f0acd2c11', 'volume_name': 'volume-09342b7d-02e6-440c-8f2c-449f0acd2c11', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365a76c2-4773-44c1-a4ac-8cd84076b98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365a76c2-4773-44c1-a4ac-8cd84076b98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109e91cf-62ce-47cd-b509-90530d492ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:53 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Volume 09342b7d-02e6-440c-8f2c-449f0acd2c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09342b7d-02e6-440c-8f2c-449f0acd2c11', 'volume_size': 1}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-620317918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09342b7d-02e6-440c-8f2c-449f0acd2c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:53Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Creating volume 09342b7d-02e6-440c-8f2c-449f0acd2c11 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:34:53 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:34:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:53 devstack quobyte-client[84024]: System call of process 99809 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:34:53 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=130, name=volume-09342b7d-02e6-440c-8f2c-449f0acd2c11, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:34:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11 1073741824" returned: 0 in 0.711s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:54 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:54 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:34:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (a62d2ca5-21d8-42eb-a1be-ebc563d2e671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3941d7e-232f-48c3-b61d-814298441f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3941d7e-232f-48c3-b61d-814298441f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-722878464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6606740b-9256-43d4-a4ef-d0cbd1ea215f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:54Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff23db81-6d31-46b3-8e11-bfdd50be2d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff23db81-6d31-46b3-8e11-bfdd50be2d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48bd768-af1c-4a59-b7f6-ad9417fe8977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48bd768-af1c-4a59-b7f6-ad9417fe8977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6606740b-9256-43d4-a4ef-d0cbd1ea215f', 'volume_name': 'volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c8d96a-ec9d-4527-a3ff-f0a781beb368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c8d96a-ec9d-4527-a3ff-f0a781beb368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d0c6dc-ac27-49b5-9252-c379ed343c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Volume 6606740b-9256-43d4-a4ef-d0cbd1ea215f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f', 'volume_size': 1}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11" returned: 0 in 0.842s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] <== create_volume: return (1636ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (bdbc72a4-d4fa-4a17-ab83-98d60de40440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b4dfb9-c649-49da-856c-b7ccccc11a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-722878464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6606740b-9256-43d4-a4ef-d0cbd1ea215f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:54Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Creating volume 6606740b-9256-43d4-a4ef-d0cbd1ea215f {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:34:55 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:55 devstack quobyte-client[84024]: System call of process 99813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:34:55 devstack quobyte-client[84024]: System call of process 99813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:34:55 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=131, name=volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109e91cf-62ce-47cd-b509-90530d492ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09342b7d-02e6-440c-8f2c-449f0acd2c11', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0998f43-7412-466d-9b10-50096b63fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (a593d432-4958-4508-ac3a-f603596db5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d87d321-5413-46ee-bd78-4a2c94cf8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d87d321-5413-46ee-bd78-4a2c94cf8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1284500985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5f86f2-a550-4018-a11e-29ff94829ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:55Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241285d1-4f17-400c-b188-80270b6cbfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241285d1-4f17-400c-b188-80270b6cbfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0071a13-dd9c-4505-a429-08ab7ee1cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0071a13-dd9c-4505-a429-08ab7ee1cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c5f86f2-a550-4018-a11e-29ff94829ef1', 'volume_name': 'volume-0c5f86f2-a550-4018-a11e-29ff94829ef1', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c495527a-9eb9-4c40-b63e-bd527b237381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c495527a-9eb9-4c40-b63e-bd527b237381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30e83bd-e966-4c3f-b501-30a4ad2eb5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:55 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Volume 0c5f86f2-a550-4018-a11e-29ff94829ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c5f86f2-a550-4018-a11e-29ff94829ef1', 'volume_size': 1}
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:55 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Volume volume-09342b7d-02e6-440c-8f2c-449f0acd2c11 (09342b7d-02e6-440c-8f2c-449f0acd2c11): created successfully
Sep 23 15:34:55 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0998f43-7412-466d-9b10-50096b63fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (dd1f9cf6-0af2-43c6-8fb9-e318698efec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b4dfb9-c649-49da-856c-b7ccccc11a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138476756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:54Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9173e0ff-9565-4caa-94ad-76497edbb365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9173e0ff-9565-4caa-94ad-76497edbb365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388ef6b7-9611-452b-8b95-4280c455ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388ef6b7-9611-452b-8b95-4280c455ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4', 'volume_name': 'volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d776ae-8938-4c2e-86a1-8ddd5d1277e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d776ae-8938-4c2e-86a1-8ddd5d1277e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fb7070-9cb3-437b-8a02-6f6734e1f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:56 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Volume 7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4', 'volume_size': 1}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f 1073741824" returned: 0 in 0.933s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:56 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-bc052c97-f581-43a0-a3c8-a2571f4eb72e tempest-CreateVolumesFromImageTest-1853759015 None] Created volume successfully.
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f" returned: 0 in 1.230s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] <== create_volume: return (2204ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1284500985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5f86f2-a550-4018-a11e-29ff94829ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:55Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Creating volume 0c5f86f2-a550-4018-a11e-29ff94829ef1 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:34:57 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:57 devstack quobyte-client[84024]: System call of process 99853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:34:57 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=132, name=volume-0c5f86f2-a550-4018-a11e-29ff94829ef1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d0c6dc-ac27-49b5-9252-c379ed343c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dee638-d82c-4afe-8bdc-aca71d40c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:57 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:34:57 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (6e18f605-10a3-41bd-9b00-dd8986e34ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee57472-38fa-4022-903c-c90afa23b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee57472-38fa-4022-903c-c90afa23b86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600364583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:56Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fd0887-ea93-4eb2-9ce4-28003b55d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fd0887-ea93-4eb2-9ce4-28003b55d2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4eec3a-83d0-4130-9929-07de96e8ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4eec3a-83d0-4130-9929-07de96e8ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0', 'volume_name': 'volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588a4754-da5d-4f95-8f0c-8b86ac43d2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588a4754-da5d-4f95-8f0c-8b86ac43d2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000222dc-13e3-4491-809e-7bfc02a523d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:58 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Volume 5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0', 'volume_size': 1}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:58 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Volume volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f (6606740b-9256-43d4-a4ef-d0cbd1ea215f): created successfully
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dee638-d82c-4afe-8bdc-aca71d40c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (a62d2ca5-21d8-42eb-a1be-ebc563d2e671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1 1073741824" returned: 0 in 0.777s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2a04ebaf-5ca8-4084-afb0-374f3ebc6be1 tempest-CreateVolumesFromImageTest-1853759015 None] Created volume successfully.
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1" returned: 0 in 0.367s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] <== create_volume: return (1184ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.528s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138476756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:54Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Creating volume 7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:34:58 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:34:58 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:58 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=133, name=volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30e83bd-e966-4c3f-b501-30a4ad2eb5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5f86f2-a550-4018-a11e-29ff94829ef1', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d171989d-7086-4d97-83aa-3d99be82cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:34:59 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Volume volume-0c5f86f2-a550-4018-a11e-29ff94829ef1 (0c5f86f2-a550-4018-a11e-29ff94829ef1): created successfully
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d171989d-7086-4d97-83aa-3d99be82cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (a593d432-4958-4508-ac3a-f603596db5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 1073741824" returned: 0 in 0.709s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:34:59 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2de453c4-8a75-456c-8df2-7ade1c850053 tempest-CreateVolumesFromImageTest-1853759015 None] Created volume successfully.
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4" returned: 0 in 0.490s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:34:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] <== create_volume: return (1271ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600364583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476acee0db2f46398e364f31fd8778be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:34:56Z,use_quota=True,user_id='8087ba8b7f1e49dbaa80dcb90a0a9a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Creating volume 5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:35:00 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:00 devstack quobyte-client[84024]: System call of process 99863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:00 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=134, name=volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fb7070-9cb3-437b-8a02-6f6734e1f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054c730b-c518-45dc-b05c-f6a3f608eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 1073741824" returned: 0 in 0.827s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:01 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Volume volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 (7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4): created successfully
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054c730b-c518-45dc-b05c-f6a3f608eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (bdbc72a4-d4fa-4a17-ab83-98d60de40440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:35:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c98562e5-6aa7-4ef6-ba63-0cba8da844b5 tempest-CreateVolumesFromImageTest-1853759015 None] Created volume successfully.
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0" returned: 0 in 0.647s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] <== create_volume: return (1528ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000222dc-13e3-4491-809e-7bfc02a523d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea547ddd-bef4-4693-b42e-7297f5dff256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:35:01 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Volume volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 (5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0): created successfully
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea547ddd-bef4-4693-b42e-7297f5dff256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:35:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Flow 'volume_create_manager' (6e18f605-10a3-41bd-9b00-dd8986e34ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:35:01 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-bbe0eb83-30de-4d78-8e20-9f083f134fae tempest-CreateVolumesFromImageTest-1853759015 None] Created volume successfully.
Sep 23 15:35:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-quobyte-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:02 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0" acquired by "delete_volume" :: waited 0.039s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:02 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[40abe1fb-e568-4586-b56b-2793b916228e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:35:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:03 devstack quobyte-client[84024]: System call of process 99867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0" returned: 0 in 0.554s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0" returned: 0 in 0.099s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0" released by "delete_volume" :: held 0.839s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Created reservations ['98482262-c5e2-49e3-aa9b-c5cb3b79365e', '43adf680-3b3a-45c5-918a-3a7f128297a1', 'd6de1cc1-cbff-4e64-9d35-0fd885fce99f', '8815ec0f-2845-4d2f-b8ac-c9e0dd81e602'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.097s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:35:04 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Deleted volume successfully.
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-295fc35e-d952-4c9d-ade4-76f7e978fb43 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-5ad75bc7-eed1-4ea6-b13b-8dc428a1d1e0-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-0c5f86f2-a550-4018-a11e-29ff94829ef1-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-0c5f86f2-a550-4018-a11e-29ff94829ef1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:04 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-quobyte-0c5f86f2-a550-4018-a11e-29ff94829ef1" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-0c5f86f2-a550-4018-a11e-29ff94829ef1" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e07ef2-27e7-464f-980b-a319cd46c3b0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:35:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:05 devstack quobyte-client[84024]: System call of process 99875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:05 devstack quobyte-client[84024]: System call of process 99875 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1" returned: 0 in 0.643s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-0c5f86f2-a550-4018-a11e-29ff94829ef1" returned: 0 in 0.131s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:05 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-0c5f86f2-a550-4018-a11e-29ff94829ef1" released by "delete_volume" :: held 0.968s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Created reservations ['2612d933-296a-43de-9027-2ddb33ab1943', 'a7ddcb23-35bc-455a-be17-f3199393ff33', '13f51634-b1ea-4cb4-9a09-febac0c7b57e', 'a903db00-31ed-404a-8c52-beabed368964'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:35:06 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a0366e44-940b-4934-9d52-4841d3fe04ca req-fda789bf-1510-47ae-aa6a-54350f5a224d tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:06 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-a0366e44-940b-4934-9d52-4841d3fe04ca req-fda789bf-1510-47ae-aa6a-54350f5a224d tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:06 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-a0366e44-940b-4934-9d52-4841d3fe04ca req-fda789bf-1510-47ae-aa6a-54350f5a224d tempest-TestShelveInstance-1549211440 None] Terminate volume connection completed successfully.
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-a0366e44-940b-4934-9d52-4841d3fe04ca req-fda789bf-1510-47ae-aa6a-54350f5a224d tempest-TestShelveInstance-1549211440 None] Deleting attachment 1b2fb56e-a0ed-4bcb-b235-9ba25990c5e4. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.126s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:35:06 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Deleted volume successfully.
Sep 23 15:35:06 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0b0e8d83-f838-4da6-9c4c-a4dff7cf0a15 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-0c5f86f2-a550-4018-a11e-29ff94829ef1-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-quobyte-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44c6e7b-f985-45c1-b501-bca4432ba78f]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4" returned: 0 in 0.510s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4" returned: 0 in 0.116s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4" released by "delete_volume" :: held 0.853s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Created reservations ['7616ad2d-8d61-485b-a3f5-cbcf02db8a98', '2cee1ac3-70b4-4ec1-9ab2-376cf06e7194', 'ba32b046-b9e0-48ad-b11c-1bf7af1b20d2', 'e2d69a22-7d3b-47d9-9e36-b1803386132b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.124s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:08 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:35:08 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Deleted volume successfully.
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-a877aa26-176e-4e0c-aadd-8e020652e028 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-7263d0c7-6daf-4eb1-b3f7-8d0b398d5de4-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-6606740b-9256-43d4-a4ef-d0cbd1ea215f-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-6606740b-9256-43d4-a4ef-d0cbd1ea215f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-quobyte-6606740b-9256-43d4-a4ef-d0cbd1ea215f" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.460s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-6606740b-9256-43d4-a4ef-d0cbd1ea215f" acquired by "delete_volume" :: waited 0.079s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d450430b-fbbf-4807-befb-3cf1896ab3c2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:10 devstack quobyte-client[84024]: System call of process 99890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f" returned: 0 in 0.450s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-6606740b-9256-43d4-a4ef-d0cbd1ea215f" returned: 0 in 0.103s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-6606740b-9256-43d4-a4ef-d0cbd1ea215f" released by "delete_volume" :: held 0.746s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Created reservations ['bd5eb9e6-5b5d-4281-a0bd-154eff4069ea', 'e0696963-2827-4c50-a529-6218743ee704', '7ba3a077-89d3-4502-a3e4-d3e806863ba6', 'dc643f9b-4195-4b90-a492-2c33732d4160'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.092s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:35:11 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Deleted volume successfully.
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-09342b7d-02e6-440c-8f2c-449f0acd2c11-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-06ba568d-dcb7-4771-9019-43a6f4c9b29e tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-6606740b-9256-43d4-a4ef-d0cbd1ea215f-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-09342b7d-02e6-440c-8f2c-449f0acd2c11-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:12 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "cinder-quobyte-09342b7d-02e6-440c-8f2c-449f0acd2c11" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:35:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-09342b7d-02e6-440c-8f2c-449f0acd2c11" acquired by "delete_volume" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:35:12 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e8fd57-aced-45ea-b40e-07d275afbf70]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:35:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:12 devstack quobyte-client[84024]: System call of process 99902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11" returned: 0 in 0.869s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[15357cc3-5644-4974-bda3-8604ce3f9c9e]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-09342b7d-02e6-440c-8f2c-449f0acd2c11" returned: 0 in 0.260s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-quobyte-09342b7d-02e6-440c-8f2c-449f0acd2c11" released by "delete_volume" :: held 1.334s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Created reservations ['b6bf6ee3-6453-4bfa-86c3-3cc3c6b13e14', 'fc5cdc76-a4be-49dd-aaeb-031ef2d148c0', 'd28bd3e1-bb86-4db8-8b60-e7c53d5f31c5', 'd59e0490-3a62-450d-9e50-d32a637a48ca'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 0.625s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:35:14 devstack quobyte-client[84024]: System call of process 99909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:14 devstack quobyte-client[84024]: System call of process 99909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 1 in 0.623s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.508s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.417s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:35:14 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:35:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Deleted volume successfully.
Sep 23 15:35:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31', 'name': 'volume-f70d404f-077c-4d89-810d-09ac13365914', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '115458a5-a829-41e3-9faa-0b7331cb1d64', 'enforce_multipath': True} {{(pid=84009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 23 15:35:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:35:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9c21c41c-7c4d-4d96-8afd-2be61f549e45 tempest-CreateVolumesFromImageTest-1853759015 None] Lock "cinder-09342b7d-02e6-440c-8f2c-449f0acd2c11-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:35:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-e08f0de9-279d-4449-addc-1b3f7a555acb req-ffdc9997-7164-490c-864b-483c45285899 tempest-TestShelveInstance-1549211440 None] attachment_update completed successfully.
Sep 23 15:35:25 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=55,cinder:SELECT=40,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:35:25 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=33,cinder:UPDATE=48,cinder:DELETE=9,cinder:INSERT=14 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.094s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:36:09 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:36:13 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:36:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-a4af195c-f362-43b4-9478-0602e65a85dc tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:36:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-a4af195c-f362-43b4-9478-0602e65a85dc tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:36:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-a4af195c-f362-43b4-9478-0602e65a85dc tempest-TestShelveInstance-1549211440 None] Terminate volume connection completed successfully.
Sep 23 15:36:46 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-a4af195c-f362-43b4-9478-0602e65a85dc tempest-TestShelveInstance-1549211440 None] Deleting attachment 115458a5-a829-41e3-9faa-0b7331cb1d64. {{(pid=84009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 23 15:36:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Acquiring lock "cinder-f70d404f-077c-4d89-810d-09ac13365914-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:36:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Lock "cinder-f70d404f-077c-4d89-810d-09ac13365914-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:36:46 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:36:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Acquiring lock "cinder-quobyte-f70d404f-077c-4d89-810d-09ac13365914" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:36:46 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Lock "cinder-quobyte-f70d404f-077c-4d89-810d-09ac13365914" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:36:47 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[191dd888-da67-46b0-807d-73c951819fb1]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:36:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:36:47 devstack quobyte-client[84024]: System call of process 100566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:36:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 0.539s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:36:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:36:48 devstack quobyte-client[84024]: System call of process 100568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 1 in 0.404s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-f70d404f-077c-4d89-810d-09ac13365914" returned: 0 in 0.110s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Lock "cinder-quobyte-f70d404f-077c-4d89-810d-09ac13365914" released by "delete_volume" :: held 1.337s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG cinder.quota [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Created reservations ['add1a61b-27b8-45fd-ad1d-6605eb6afd24', '91e98f53-c9be-4384-939d-bbc89681330f', '3a52fee8-ed8a-490a-a741-9328ed545d2f', '7fd762c0-9134-4ea5-8bf8-047ac2d6601e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.085s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:36:48 devstack cinder-volume[84009]: DEBUG cinder.manager [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:36:49 devstack cinder-volume[84009]: INFO cinder.volume.manager [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Deleted volume successfully.
Sep 23 15:36:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [req-28412ad2-bee8-4ef8-ab59-f249f0a0cb32 req-b1ad5f60-33e6-42d5-9243-4a1f9025c56d tempest-TestShelveInstance-1549211440 None] Lock "cinder-f70d404f-077c-4d89-810d-09ac13365914-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:36:58 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:36:59 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:37:06 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (ca996feb-3cf9-4516-9c00-5960ce27c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c818ac-4100-4f96-980c-dd9ec4fefc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c818ac-4100-4f96-980c-dd9ec4fefc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740252256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cf347d-8aaf-40df-891f-25f9ab3ef1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:06Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2a8500-b780-479a-8b78-e8c16d7911ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2a8500-b780-479a-8b78-e8c16d7911ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa20d9d1-a4a1-49e4-9696-6b28aefa5170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa20d9d1-a4a1-49e4-9696-6b28aefa5170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98cf347d-8aaf-40df-891f-25f9ab3ef1bf', 'volume_name': 'volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cae852e-6d0e-4ebe-98ed-f86e6e7c02ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cae852e-6d0e-4ebe-98ed-f86e6e7c02ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd4ebc6-477b-402f-a5bf-3426ce7e4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:06 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume 98cf347d-8aaf-40df-891f-25f9ab3ef1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf', 'volume_size': 1}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740252256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cf347d-8aaf-40df-891f-25f9ab3ef1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:06Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Creating volume 98cf347d-8aaf-40df-891f-25f9ab3ef1bf {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:06 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:06 devstack quobyte-client[84024]: System call of process 100581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:06 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=135, name=volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf 1073741824" returned: 0 in 0.377s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf" returned: 0 in 0.105s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.566s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd4ebc6-477b-402f-a5bf-3426ce7e4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230ffbd5-9375-466b-8a9b-21566d4c90fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:07 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf (98cf347d-8aaf-40df-891f-25f9ab3ef1bf): created successfully
Sep 23 15:37:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230ffbd5-9375-466b-8a9b-21566d4c90fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (ca996feb-3cf9-4516-9c00-5960ce27c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:07 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4e2af370-12ff-44ac-9e9d-58cdddd279a9 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created volume successfully.
Sep 23 15:37:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (2bcc4ccc-6152-4c1f-b562-870ab729a96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b849c792-8bcb-45a1-acae-f69398442b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b849c792-8bcb-45a1-acae-f69398442b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468153192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed637add-83db-450a-a620-0ef88c09157b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:08Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41950b8-1b57-4dca-b5a8-c2ae0d20f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e41950b8-1b57-4dca-b5a8-c2ae0d20f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a5672-3207-4a7d-b4b2-a2100a62567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a5672-3207-4a7d-b4b2-a2100a62567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed637add-83db-450a-a620-0ef88c09157b', 'volume_name': 'volume-ed637add-83db-450a-a620-0ef88c09157b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf74073-46f2-4b2b-a1cf-590bab88cb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf74073-46f2-4b2b-a1cf-590bab88cb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b881d7f8-177f-46f3-9a0a-cdcdb216a865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume ed637add-83db-450a-a620-0ef88c09157b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed637add-83db-450a-a620-0ef88c09157b', 'volume_size': 1}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468153192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed637add-83db-450a-a620-0ef88c09157b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:08Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Creating volume ed637add-83db-450a-a620-0ef88c09157b {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:08 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:08 devstack quobyte-client[84024]: System call of process 100587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:08 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=136, name=volume-ed637add-83db-450a-a620-0ef88c09157b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b 1073741824" returned: 0 in 0.538s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:09 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (1dff2d7a-63c9-4f2e-ab04-f86974314dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddad93e-8e3e-4a66-aca5-18a689e27cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (15fc499f-ffbd-4ecd-947a-aa5319cea765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57885b39-c487-4360-a01d-bb883f076870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddad93e-8e3e-4a66-aca5-18a689e27cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71740533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5d29df-4e27-4dbb-b449-d0c991927188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:09Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaf1168-b2b1-4e83-96a4-cb547637d9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaf1168-b2b1-4e83-96a4-cb547637d9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69b356b-c898-4fac-984f-8bd1c4efd78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69b356b-c898-4fac-984f-8bd1c4efd78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5d29df-4e27-4dbb-b449-d0c991927188', 'volume_name': 'volume-8d5d29df-4e27-4dbb-b449-d0c991927188', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232012b8-70a1-459a-82c5-f66b7a2188a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232012b8-70a1-459a-82c5-f66b7a2188a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e2c5ae-a878-4fb4-84ff-37b3fcc088c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume 8d5d29df-4e27-4dbb-b449-d0c991927188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5d29df-4e27-4dbb-b449-d0c991927188', 'volume_size': 1}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b" returned: 0 in 1.074s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] <== create_volume: return (1671ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-71740533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5d29df-4e27-4dbb-b449-d0c991927188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:09Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Creating volume 8d5d29df-4e27-4dbb-b449-d0c991927188 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:10 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:10 devstack quobyte-client[84024]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:10 devstack quobyte-client[84024]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:10 devstack quobyte-client[84024]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:10 devstack quobyte-client[84024]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:10 devstack quobyte-client[84024]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:10 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=137, name=volume-8d5d29df-4e27-4dbb-b449-d0c991927188, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57885b39-c487-4360-a01d-bb883f076870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580738326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325a4245-6e59-40a1-97d5-dba9ebc13ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:09Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2d6340-2bb2-4b5e-99ef-55faf7960812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2d6340-2bb2-4b5e-99ef-55faf7960812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1431041-a6ab-48c0-900c-79d37007b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1431041-a6ab-48c0-900c-79d37007b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325a4245-6e59-40a1-97d5-dba9ebc13ff0', 'volume_name': 'volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb3d4a7-d83e-4b6a-9541-8438e8f420e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffb3d4a7-d83e-4b6a-9541-8438e8f420e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a59fc1c-34f0-484c-8d78-4454c49f37f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume 325a4245-6e59-40a1-97d5-dba9ebc13ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0', 'volume_size': 1}
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:10 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (574f44c0-edf2-4a5f-ae78-2ca32f105ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a4d67f-9942-45ed-af59-5f59404316c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a4d67f-9942-45ed-af59-5f59404316c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303795747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:10Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31641526-808d-4f07-90b5-22274c7388c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31641526-808d-4f07-90b5-22274c7388c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc61f9c9-27bc-4d5c-9e12-85b0f87249be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc61f9c9-27bc-4d5c-9e12-85b0f87249be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5', 'volume_name': 'volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab356f9b-a62d-4ae9-ae9d-a032d4d5bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab356f9b-a62d-4ae9-ae9d-a032d4d5bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4de350f-f8ec-45fe-8001-751a8fca17d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume 3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5', 'volume_size': 1}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b881d7f8-177f-46f3-9a0a-cdcdb216a865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed637add-83db-450a-a620-0ef88c09157b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cea326-98a7-4fc0-94be-dac84986f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 1.315s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (60da6279-6eb9-46c6-8c90-2aae87ed393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0320d9f7-770d-4095-9d9c-e629a68ca521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume volume-ed637add-83db-450a-a620-0ef88c09157b (ed637add-83db-450a-a620-0ef88c09157b): created successfully
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cea326-98a7-4fc0-94be-dac84986f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (2bcc4ccc-6152-4c1f-b562-870ab729a96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188 1073741824" returned: 0 in 0.769s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:11 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2d562dbd-7a48-4f46-ad59-149666834948 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created volume successfully.
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0320d9f7-770d-4095-9d9c-e629a68ca521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379241738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a2cfff-f09e-43bd-941f-600d1e0d2827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:10Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99144116-8697-4f47-96a5-342adce68b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99144116-8697-4f47-96a5-342adce68b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e8beb0-995f-4155-8b34-fa3fc5c45266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e8beb0-995f-4155-8b34-fa3fc5c45266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a2cfff-f09e-43bd-941f-600d1e0d2827', 'volume_name': 'volume-55a2cfff-f09e-43bd-941f-600d1e0d2827', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0a3921-00dc-4d96-bff1-dc7f0c47f594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0a3921-00dc-4d96-bff1-dc7f0c47f594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e60561f-288e-49eb-b603-0c171aedf7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume 55a2cfff-f09e-43bd-941f-600d1e0d2827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a2cfff-f09e-43bd-941f-600d1e0d2827', 'volume_size': 1}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188" returned: 0 in 0.377s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] <== create_volume: return (1172ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580738326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325a4245-6e59-40a1-97d5-dba9ebc13ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:09Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Creating volume 325a4245-6e59-40a1-97d5-dba9ebc13ff0 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:11 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:11 devstack quobyte-client[84024]: System call of process 100596 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:11 devstack quobyte-client[84024]: System call of process 100596 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:11 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=138, name=volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e2c5ae-a878-4fb4-84ff-37b3fcc088c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5d29df-4e27-4dbb-b449-d0c991927188', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea875e0-e9e4-4a4c-b6f9-8bffe14607ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume volume-8d5d29df-4e27-4dbb-b449-d0c991927188 (8d5d29df-4e27-4dbb-b449-d0c991927188): created successfully
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea875e0-e9e4-4a4c-b6f9-8bffe14607ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (1dff2d7a-63c9-4f2e-ab04-f86974314dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0 1073741824" returned: 0 in 0.471s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5b67a894-9d91-408b-8a80-643761ccba3c tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created volume successfully.
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0" returned: 0 in 0.260s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303795747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:10Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Creating volume 3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:12 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:12 devstack quobyte-client[84024]: System call of process 100600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:12 devstack quobyte-client[84024]: System call of process 100600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:12 devstack quobyte-client[84024]: System call of process 100600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:12 devstack quobyte-client[84024]: System call of process 100600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:12 devstack quobyte-client[84024]: System call of process 100600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:12 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=139, name=volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a59fc1c-34f0-484c-8d78-4454c49f37f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab5cd50-fbb0-4fd2-a6f1-d42aa09faa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0 (325a4245-6e59-40a1-97d5-dba9ebc13ff0): created successfully
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab5cd50-fbb0-4fd2-a6f1-d42aa09faa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (15fc499f-ffbd-4ecd-947a-aa5319cea765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 1073741824" returned: 0 in 0.443s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3eaf98e0-d130-4958-a744-cfb379fa8667 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created volume successfully.
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5" returned: 0 in 0.239s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] <== create_volume: return (714ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.631s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379241738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a2cfff-f09e-43bd-941f-600d1e0d2827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10029c34bc5a40379a3d8c58dfbeb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:10Z,use_quota=True,user_id='a4c61c7bd5664989be74fc4a3aee96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Creating volume 55a2cfff-f09e-43bd-941f-600d1e0d2827 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:13 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:13 devstack quobyte-client[84024]: System call of process 100604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:13 devstack quobyte-client[84024]: System call of process 100604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=140, name=volume-55a2cfff-f09e-43bd-941f-600d1e0d2827, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4de350f-f8ec-45fe-8001-751a8fca17d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae21e7d4-a4c4-4e85-8498-4a7ac66bf317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 (3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5): created successfully
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae21e7d4-a4c4-4e85-8498-4a7ac66bf317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (574f44c0-edf2-4a5f-ae78-2ca32f105ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827 1073741824" returned: 0 in 0.509s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-abd067ce-6db3-4c63-b775-6f50a893d45e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created volume successfully.
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827" returned: 0 in 0.250s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] <== create_volume: return (795ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e60561f-288e-49eb-b603-0c171aedf7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a2cfff-f09e-43bd-941f-600d1e0d2827', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d66e2-cf35-46ba-8e86-9d738314e16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume volume-55a2cfff-f09e-43bd-941f-600d1e0d2827 (55a2cfff-f09e-43bd-941f-600d1e0d2827): created successfully
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d66e2-cf35-46ba-8e86-9d738314e16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Flow 'volume_create_manager' (60da6279-6eb9-46c6-8c90-2aae87ed393f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-41d47a79-a9a1-4163-99c8-6c11df9ebee7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created volume successfully.
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-55a2cfff-f09e-43bd-941f-600d1e0d2827-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-55a2cfff-f09e-43bd-941f-600d1e0d2827-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-quobyte-55a2cfff-f09e-43bd-941f-600d1e0d2827" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-55a2cfff-f09e-43bd-941f-600d1e0d2827" acquired by "delete_volume" :: waited 0.013s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d3c1f-4095-4f07-bd7f-33b27a06b687]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827" returned: 0 in 0.429s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-55a2cfff-f09e-43bd-941f-600d1e0d2827" returned: 0 in 0.100s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-55a2cfff-f09e-43bd-941f-600d1e0d2827" released by "delete_volume" :: held 0.716s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created reservations ['2e9abc9a-e49f-485f-b015-f5aeff2e3ab3', 'a215b40d-227e-44b1-b198-9ae1b986d002', '87c467c9-1269-4b71-8b44-3962319f0876', '560334ab-d573-4709-94d7-2cd35b32df9c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.088s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Deleted volume successfully.
Sep 23 15:37:16 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9901da16-e06f-4a23-a412-d31cf9f1eade tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-55a2cfff-f09e-43bd-941f-600d1e0d2827-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-quobyte-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5" acquired by "delete_volume" :: waited 0.015s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a988c1e-d2a7-496d-9bd8-52ee736604a2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5" returned: 0 in 0.421s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5" returned: 0 in 0.099s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5" released by "delete_volume" :: held 0.683s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created reservations ['873418b0-7919-4c03-98a4-f3569884b275', '27e12ea3-af72-490e-b439-077c12e5fdab', '531a64b9-a3a1-4a21-a539-fed07c118959', 'd7956016-1525-4fc7-afe5-db3307889e02'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.088s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:18 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Deleted volume successfully.
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b3463199-e4ef-4113-8ed2-8428e39cbd6b tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-3b42e5c7-d6a4-407d-8859-c9ee0aaaebd5-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-325a4245-6e59-40a1-97d5-dba9ebc13ff0-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-325a4245-6e59-40a1-97d5-dba9ebc13ff0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:19 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-quobyte-325a4245-6e59-40a1-97d5-dba9ebc13ff0" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-325a4245-6e59-40a1-97d5-dba9ebc13ff0" acquired by "delete_volume" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba5bde-0439-4b5a-8d81-9beaf2990269]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0" returned: 0 in 0.408s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-325a4245-6e59-40a1-97d5-dba9ebc13ff0" returned: 0 in 0.091s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-325a4245-6e59-40a1-97d5-dba9ebc13ff0" released by "delete_volume" :: held 0.670s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created reservations ['18a9668a-4f06-445d-886a-d6efad6f87f8', '9b1ccee2-6bb6-488a-9d05-c5e2bc70dca3', 'c59b6e00-37fc-451b-9b86-867e0b02c038', '5b6867a9-2d92-4b19-9797-2c6f16dcb930'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.087s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:21 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Deleted volume successfully.
Sep 23 15:37:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c33e1dce-415e-4677-8d66-900e74a5ce4f tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-325a4245-6e59-40a1-97d5-dba9ebc13ff0-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-8d5d29df-4e27-4dbb-b449-d0c991927188-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-8d5d29df-4e27-4dbb-b449-d0c991927188-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:22 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-quobyte-8d5d29df-4e27-4dbb-b449-d0c991927188" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-8d5d29df-4e27-4dbb-b449-d0c991927188" acquired by "delete_volume" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14f599-28af-4ccc-9866-df78bb131181]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188" returned: 0 in 0.400s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-8d5d29df-4e27-4dbb-b449-d0c991927188" returned: 0 in 0.114s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-8d5d29df-4e27-4dbb-b449-d0c991927188" released by "delete_volume" :: held 0.671s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:22 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created reservations ['ffa9840a-2192-42ab-b127-dd3b8dca38c7', 'b7ad866f-0d24-48db-8f07-eb81a8e025ac', '1eeb8fae-7134-40a2-9a2f-f46f0b7f49a5', 'e7572b77-e4c0-4b01-a819-567cb9706bd0'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.110s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:23 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Deleted volume successfully.
Sep 23 15:37:23 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-346eb668-34d7-4904-82ea-f011830f65c7 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-8d5d29df-4e27-4dbb-b449-d0c991927188-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-ed637add-83db-450a-a620-0ef88c09157b-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-ed637add-83db-450a-a620-0ef88c09157b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:24 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-quobyte-ed637add-83db-450a-a620-0ef88c09157b" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-ed637add-83db-450a-a620-0ef88c09157b" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e57dc-6648-4534-9906-4f0f91e88ef2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b" returned: 0 in 0.408s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ed637add-83db-450a-a620-0ef88c09157b" returned: 0 in 0.110s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-ed637add-83db-450a-a620-0ef88c09157b" released by "delete_volume" :: held 0.665s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created reservations ['1afe590d-04df-4bd2-9965-df3298e5d486', 'ba7189d9-9185-4dc0-8972-462892f24b96', '0f0fec07-6fd1-4509-9ff0-6566d89dbd89', '68fc30d6-30ee-4d05-a35b-9bd5214c7991'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.115s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:25 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Deleted volume successfully.
Sep 23 15:37:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-779d6111-2c45-48cc-adf4-84d47d56e059 tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-ed637add-83db-450a-a620-0ef88c09157b-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-98cf347d-8aaf-40df-891f-25f9ab3ef1bf-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-98cf347d-8aaf-40df-891f-25f9ab3ef1bf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:26 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "cinder-quobyte-98cf347d-8aaf-40df-891f-25f9ab3ef1bf" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-98cf347d-8aaf-40df-891f-25f9ab3ef1bf" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:26 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af99945-ba2f-4bcd-8e86-b2868f349166]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:27 devstack quobyte-client[84024]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:27 devstack quobyte-client[84024]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:27 devstack quobyte-client[84024]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:27 devstack quobyte-client[84024]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf" returned: 0 in 0.433s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-98cf347d-8aaf-40df-891f-25f9ab3ef1bf" returned: 0 in 0.096s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-quobyte-98cf347d-8aaf-40df-891f-25f9ab3ef1bf" released by "delete_volume" :: held 0.696s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Created reservations ['68ab399b-be0f-4135-b648-a355beea175b', '7a93964e-98ee-4737-9b79-9010adfd1d84', 'd2ce2ffc-625f-44f5-aa2c-95f5ef48e879', '98345e04-6458-49dc-81bc-d536ad7f4503'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.089s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:27 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:28 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Deleted volume successfully.
Sep 23 15:37:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c0dfde08-184e-487c-8fdc-8ea98fa7629e tempest-CreateVolumesFromSourceVolumeTest-1164959357 None] Lock "cinder-98cf347d-8aaf-40df-891f-25f9ab3ef1bf-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Flow 'volume_create_manager' (9b32f92f-0610-4300-9295-9e934c3ebf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8811047-6f80-4a47-99f3-28df708befdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8811047-6f80-4a47-99f3-28df708befdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcabef0-6550-480e-baeb-7f316ee9b765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f12b737c56f46058a5a7991a5ff7a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:34Z,use_quota=True,user_id='b8abdd063f0b4acfb2adecade0b09523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4ec688-c63e-4637-b9a4-dc9265d5146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4ec688-c63e-4637-b9a4-dc9265d5146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfadab58-ba10-4719-b2a4-92f3de6faa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfadab58-ba10-4719-b2a4-92f3de6faa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfcabef0-6550-480e-baeb-7f316ee9b765', 'volume_name': 'volume-cfcabef0-6550-480e-baeb-7f316ee9b765', 'volume_size': 1, 'image_id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2859df8-3c6f-4361-8020-e92c96edd992', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab15650ec9b7e0c287e4ff16ec2764d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f12b737c56f46058a5a7991a5ff7a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bd1a65cd8d4a60015f9e14ed128b700682eb73c84ae44016e330691ff838a0bb6c4e89621d3dd4117cacb9840b2571119716b8f4ac76836f208bc5530a7ef10', 'id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'created_at': datetime.datetime(2025, 9, 23, 13, 37, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2859df8-3c6f-4361-8020-e92c96edd992/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e5cab90>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8595a6-7f15-46f4-b2e3-e2f907d21c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8595a6-7f15-46f4-b2e3-e2f907d21c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a6358a-d498-4f10-83bc-9d099db213c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:34 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Volume cfcabef0-6550-480e-baeb-7f316ee9b765: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfcabef0-6550-480e-baeb-7f316ee9b765', 'volume_size': 1, 'image_id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2859df8-3c6f-4361-8020-e92c96edd992', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab15650ec9b7e0c287e4ff16ec2764d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f12b737c56f46058a5a7991a5ff7a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bd1a65cd8d4a60015f9e14ed128b700682eb73c84ae44016e330691ff838a0bb6c4e89621d3dd4117cacb9840b2571119716b8f4ac76836f208bc5530a7ef10', 'id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'created_at': datetime.datetime(2025, 9, 23, 13, 37, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2859df8-3c6f-4361-8020-e92c96edd992/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e5cab90>}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Cloning cfcabef0-6550-480e-baeb-7f316ee9b765 from image b2859df8-3c6f-4361-8020-e92c96edd992  at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2859df8-3c6f-4361-8020-e92c96edd992', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:37:34 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:37:34 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 15:37:35 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0dddff-6d64-4179-9eef-e6b7a9428ea6]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:35 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD
Sep 23 15:37:35 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:37:36 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Sep 23 15:37:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD" returned: 0 in 1.914s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:37 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD
Sep 23 15:37:37 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:37:38 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Sep 23 15:37:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD" returned: 1 in 1.979s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:37:39 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Temporary image b2859df8-3c6f-4361-8020-e92c96edd992 is fetched for user b8abdd063f0b4acfb2adecade0b09523. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:37:39 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[55906f49-bb6f-4d66-a3cc-e670bc485401]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:39 devstack sudo[100656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD
Sep 23 15:37:39 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:37:41 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root
Sep 23 15:37:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD" returned: 0 in 1.895s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:41 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD
Sep 23 15:37:41 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:37:43 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD" returned: 1 in 1.985s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcabef0-6550-480e-baeb-7f316ee9b765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f12b737c56f46058a5a7991a5ff7a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:37:34Z,use_quota=True,user_id='b8abdd063f0b4acfb2adecade0b09523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Creating volume cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:37:43 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:43 devstack quobyte-client[84024]: System call of process 100665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:43 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=141, name=volume-cfcabef0-6550-480e-baeb-7f316ee9b765, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 1073741824" returned: 0 in 0.314s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 0 in 0.131s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] <== create_volume: return (546ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:37:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:44 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Attempting download of b2859df8-3c6f-4361-8020-e92c96edd992 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2859df8-3c6f-4361-8020-e92c96edd992', 'metadata': {}}])) to volume cfcabef0-6550-480e-baeb-7f316ee9b765. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:37:44 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcbaa82-a4e0-4082-ac3f-cbfc4ad6ba02]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2859df8-3c6f-4361-8020-e92c96edd992_30uv6xm6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2859df8-3c6f-4361-8020-e92c96edd992_30uv6xm6" returned: 0 in 0.533s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2859df8-3c6f-4361-8020-e92c96edd992_30uv6xm6 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2859df8-3c6f-4361-8020-e92c96edd992_30uv6xm6" returned: 1 in 0.360s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2859df8-3c6f-4361-8020-e92c96edd992_30uv6xm6' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:37:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf323799-9866-4aa6-af43-f84016d3a0dc]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD" returned: 1 in 0.611s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] b2859df8-3c6f-4361-8020-e92c96edd992 was raw, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:46 devstack quobyte-client[84024]: System call of process 100709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:46 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=141, name=volume-cfcabef0-6550-480e-baeb-7f316ee9b765, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 0 in 0.245s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2859df8-3c6f-4361-8020-e92c96edd992_arqazozldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:37:46 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:46 devstack quobyte-client[84024]: System call of process 100714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 1G" returned: 0 in 0.162s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf1493-9a5e-4f38-9aea-7c9f6cd7a091]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:47 devstack quobyte-client[84024]: System call of process 100717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 0 in 0.406s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:47 devstack quobyte-client[84024]: System call of process 100719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 1 in 0.429s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Downloaded image b2859df8-3c6f-4361-8020-e92c96edd992 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2859df8-3c6f-4361-8020-e92c96edd992', 'metadata': {}}])) to volume cfcabef0-6550-480e-baeb-7f316ee9b765 successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Temporary image b2859df8-3c6f-4361-8020-e92c96edd992 for user b8abdd063f0b4acfb2adecade0b09523 is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:37:47 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Marking volume cfcabef0-6550-480e-baeb-7f316ee9b765 as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:37:48 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Copying metadata from image b2859df8-3c6f-4361-8020-e92c96edd992 to cfcabef0-6550-480e-baeb-7f316ee9b765. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:37:48 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Creating volume glance metadata for volume cfcabef0-6550-480e-baeb-7f316ee9b765 backed by image b2859df8-3c6f-4361-8020-e92c96edd992 with: {'image_id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ab15650ec9b7e0c287e4ff16ec2764d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:37:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a6358a-d498-4f10-83bc-9d099db213c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcabef0-6550-480e-baeb-7f316ee9b765', 'volume_size': 1, 'image_id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2859df8-3c6f-4361-8020-e92c96edd992', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab15650ec9b7e0c287e4ff16ec2764d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f12b737c56f46058a5a7991a5ff7a2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4bd1a65cd8d4a60015f9e14ed128b700682eb73c84ae44016e330691ff838a0bb6c4e89621d3dd4117cacb9840b2571119716b8f4ac76836f208bc5530a7ef10', 'id': 'b2859df8-3c6f-4361-8020-e92c96edd992', 'created_at': datetime.datetime(2025, 9, 23, 13, 37, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 37, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2859df8-3c6f-4361-8020-e92c96edd992/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e5cab90>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a55f8c-96f1-4427-8bff-fd82ea7ac164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:37:48 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Volume volume-cfcabef0-6550-480e-baeb-7f316ee9b765 (cfcabef0-6550-480e-baeb-7f316ee9b765): created successfully
Sep 23 15:37:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a55f8c-96f1-4427-8bff-fd82ea7ac164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:37:48 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Flow 'volume_create_manager' (9b32f92f-0610-4300-9295-9e934c3ebf34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:37:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2952e0cc-1cca-4718-8469-f6b696063a81 tempest-VolumeImageDependencyTests-1584316038 None] Created volume successfully.
Sep 23 15:37:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Acquiring lock "cinder-cfcabef0-6550-480e-baeb-7f316ee9b765-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Lock "cinder-cfcabef0-6550-480e-baeb-7f316ee9b765-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:49 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:37:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Acquiring lock "cinder-quobyte-cfcabef0-6550-480e-baeb-7f316ee9b765" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:37:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Lock "cinder-quobyte-cfcabef0-6550-480e-baeb-7f316ee9b765" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:37:49 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a5ece3-f54e-4a5e-8b6a-5d3365e34f87]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:37:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 0 in 0.381s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 1 in 0.357s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cfcabef0-6550-480e-baeb-7f316ee9b765" returned: 0 in 0.111s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Lock "cinder-quobyte-cfcabef0-6550-480e-baeb-7f316ee9b765" released by "delete_volume" :: held 1.123s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:37:50 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Created reservations ['17da9504-7199-423a-8130-3dfd1502312f', '34398b95-127b-4462-b160-2ecd9142b9b6', 'fc706964-11bf-47e2-9b05-9727ab77aa06', 'e16d8b40-0498-48c3-8276-8e615762a699'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.102s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:37:51 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Deleted volume successfully.
Sep 23 15:37:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f0a1585b-eed0-4765-854d-a6c2c7dd4e4e tempest-VolumeImageDependencyTests-1584316038 None] Lock "cinder-cfcabef0-6550-480e-baeb-7f316ee9b765-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:01 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=62,cinder:SELECT=39,cinder:DELETE=5,cinder:INSERT=14 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:38:01 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=56,cinder:UPDATE=81,cinder:DELETE=9,cinder:INSERT=23 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.158s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:38:13 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:38:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Flow 'volume_create_manager' (c1d3a888-3e6c-4e93-9288-8fe45547482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77975cb-506f-4475-98cb-8f69f4f9d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77975cb-506f-4475-98cb-8f69f4f9d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1272675461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c54da-5d18-4789-b242-a817fa011ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5030b46916354a34aa2d9152a413070f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:38:15Z,use_quota=True,user_id='070f381c47f9466da93c128f9068433f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a982ed8-a93a-4b9e-b231-8659afeb2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a982ed8-a93a-4b9e-b231-8659afeb2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0587fe2-7a45-4000-bb09-63eb193bf500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0587fe2-7a45-4000-bb09-63eb193bf500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482c54da-5d18-4789-b242-a817fa011ac2', 'volume_name': 'volume-482c54da-5d18-4789-b242-a817fa011ac2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791644c4-1f22-47b4-a10e-dae7db98af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791644c4-1f22-47b4-a10e-dae7db98af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0112db-26ed-4191-8cb9-24e63af781f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Volume 482c54da-5d18-4789-b242-a817fa011ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482c54da-5d18-4789-b242-a817fa011ac2', 'volume_size': 1}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1272675461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482c54da-5d18-4789-b242-a817fa011ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5030b46916354a34aa2d9152a413070f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:38:15Z,use_quota=True,user_id='070f381c47f9466da93c128f9068433f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Creating volume 482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:38:14 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:38:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:15 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=142, name=volume-482c54da-5d18-4789-b242-a817fa011ac2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 1073741824" returned: 0 in 0.334s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.092s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] <== create_volume: return (502ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.515s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0112db-26ed-4191-8cb9-24e63af781f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482c54da-5d18-4789-b242-a817fa011ac2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff81dcd8-58cd-465d-8794-be71fb7f5917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Volume volume-482c54da-5d18-4789-b242-a817fa011ac2 (482c54da-5d18-4789-b242-a817fa011ac2): created successfully
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff81dcd8-58cd-465d-8794-be71fb7f5917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Flow 'volume_create_manager' (c1d3a888-3e6c-4e93-9288-8fe45547482c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:38:15 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b34f5af6-6a7f-43f5-b3a1-00a85e0c19a7 tempest-SnapshotDependencyTests-162322717 None] Created volume successfully.
Sep 23 15:38:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Creating offline snapshot ffce314d-181e-4c6c-ac39-dcc174a93f18 of volume 482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a3ada1-0aad-4934-a9a3-130ca1db1906]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.550s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:17 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=143, name=volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 1G" returned: 0 in 0.295s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): qemu-img rebase -u -b volume-482c54da-5d18-4789-b242-a817fa011ac2 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:18 devstack quobyte-client[84024]: System call of process 100747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "qemu-img rebase -u -b volume-482c54da-5d18-4789-b242-a817fa011ac2 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.186s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.090s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.097s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.info" returned: 0 in 0.097s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.info" returned: 0 in 0.095s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:19 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-29024eea-b446-464e-baf3-fa7bb368f7b3 tempest-SnapshotDependencyTests-162322717 None] Create snapshot completed successfully
Sep 23 15:38:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Flow 'volume_create_manager' (c2347412-fe35-4727-9c29-97205f79347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb6262f-fdb5-4e62-9c7d-76c9b619d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb6262f-fdb5-4e62-9c7d-76c9b619d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea529970-8e5d-4269-8737-29830c370838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5030b46916354a34aa2d9152a413070f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffce314d-181e-4c6c-ac39-dcc174a93f18,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:38:21Z,use_quota=True,user_id='070f381c47f9466da93c128f9068433f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ca213e-42a9-464f-bc88-0c2e51702db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ca213e-42a9-464f-bc88-0c2e51702db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8da1d0-182c-435c-aa03-0f436ed5f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8da1d0-182c-435c-aa03-0f436ed5f472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea529970-8e5d-4269-8737-29830c370838', 'volume_name': 'volume-ea529970-8e5d-4269-8737-29830c370838', 'volume_size': 1, 'snapshot_id': 'ffce314d-181e-4c6c-ac39-dcc174a93f18'}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dd877b-43a1-44a2-af91-2f2747e7764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dd877b-43a1-44a2-af91-2f2747e7764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dc251a-8f84-4d6d-bf12-5fe83f0176d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:20 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Volume ea529970-8e5d-4269-8737-29830c370838: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea529970-8e5d-4269-8737-29830c370838', 'volume_size': 1, 'snapshot_id': 'ffce314d-181e-4c6c-ac39-dcc174a93f18'}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-quobyte-ffce314d-181e-4c6c-ac39-dcc174a93f18-ea529970-8e5d-4269-8737-29830c370838" by "_create_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ffce314d-181e-4c6c-ac39-dcc174a93f18-ea529970-8e5d-4269-8737-29830c370838" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Creating volume ea529970-8e5d-4269-8737-29830c370838 from snapshot ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:38:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-quobyte-ea529970-8e5d-4269-8737-29830c370838" by "_copy_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ea529970-8e5d-4269-8737-29830c370838" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] snapshot: ffce314d-181e-4c6c-ac39-dcc174a93f18, volume: ea529970-8e5d-4269-8737-29830c370838,  {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7234b10-6005-4af7-8a9c-5bfdd74f3952]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:21 devstack quobyte-client[84024]: System call of process 100755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:21 devstack quobyte-client[84024]: System call of process 100755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.414s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-482c54da-5d18-4789-b242-a817fa011ac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Creating direct copy from snapshot {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea9ce5-3aca-4229-8fc6-2c8de1238199]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:21 devstack quobyte-client[84024]: System call of process 100758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.432s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:22 devstack cinder-volume[84009]: DEBUG cinder.utils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 not found in is_blk_device check {{(pid=84009) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 23 15:38:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:22 devstack quobyte-client[84024]: System call of process 100761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:22 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=145, name=volume-ea529970-8e5d-4269-8737-29830c370838, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838" returned: 0 in 5.954s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2e216e-affe-457d-b09e-9b1e0ec7c2c4]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.587s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Image conversion details: src /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:38:28 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Converted 1024.00 MB image at 171.08 MB/s
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838" returned: 0 in 0.100s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ea529970-8e5d-4269-8737-29830c370838" released by "_copy_volume_from_snapshot" :: held 7.897s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ffce314d-181e-4c6c-ac39-dcc174a93f18-ea529970-8e5d-4269-8737-29830c370838" released by "_create_volume_from_snapshot" :: held 7.936s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.957s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dc251a-8f84-4d6d-bf12-5fe83f0176d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea529970-8e5d-4269-8737-29830c370838', 'volume_size': 1, 'snapshot_id': 'ffce314d-181e-4c6c-ac39-dcc174a93f18'}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ee1f6b-37c4-4b97-9add-5a77ae4292db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:38:29 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Volume volume-ea529970-8e5d-4269-8737-29830c370838 (ea529970-8e5d-4269-8737-29830c370838): created successfully
Sep 23 15:38:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ee1f6b-37c4-4b97-9add-5a77ae4292db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:38:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Flow 'volume_create_manager' (c2347412-fe35-4727-9c29-97205f79347d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:38:29 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-51f187bb-58f1-4a1a-9bf9-9f30cc4aebb6 tempest-SnapshotDependencyTests-162322717 None] Created volume successfully.
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-ffce314d-181e-4c6c-ac39-dcc174a93f18-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-ffce314d-181e-4c6c-ac39-dcc174a93f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-quobyte-482c54da-5d18-4789-b242-a817fa011ac2" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-482c54da-5d18-4789-b242-a817fa011ac2" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-quobyte-ffce314d-181e-4c6c-ac39-dcc174a93f18" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ffce314d-181e-4c6c-ac39-dcc174a93f18" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Deleting offline snapshot ffce314d-181e-4c6c-ac39-dcc174a93f18 of volume 482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] snapshot_file for this snap is: volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bafdb1-fb73-4686-b21e-699b16e97e50]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.448s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-482c54da-5d18-4789-b242-a817fa011ac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a58e2f-ce05-48fd-b1a5-42867289ce73]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.423s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:31 devstack quobyte-client[84024]: System call of process 100788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:31 devstack quobyte-client[84024]: System call of process 100788 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.241s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2.ffce314d-181e-4c6c-ac39-dcc174a93f18" returned: 0 in 0.089s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ffce314d-181e-4c6c-ac39-dcc174a93f18" released by "_delete_snapshot" :: held 1.512s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-482c54da-5d18-4789-b242-a817fa011ac2" released by "delete_snapshot" :: held 1.539s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Created reservations ['aeffaa9d-1b65-430c-8842-12b8a846d10c', '432a3d5c-7f48-43ec-91ba-8c520e3896cd', '15443576-c18a-4382-8ad5-127230680e1f', '24cc1e8a-bdf4-4a74-a59a-c397c740a05f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:38:32 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Delete snapshot completed successfully.
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d80ebf9f-4841-40fb-99d9-411f0289d2f8 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-ffce314d-181e-4c6c-ac39-dcc174a93f18-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-482c54da-5d18-4789-b242-a817fa011ac2-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-482c54da-5d18-4789-b242-a817fa011ac2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:32 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-quobyte-482c54da-5d18-4789-b242-a817fa011ac2" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-482c54da-5d18-4789-b242-a817fa011ac2" acquired by "delete_volume" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21c0961-1b7d-40e2-9914-0c2fed8566af]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.409s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-482c54da-5d18-4789-b242-a817fa011ac2" returned: 0 in 0.129s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-482c54da-5d18-4789-b242-a817fa011ac2" released by "delete_volume" :: held 0.712s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Created reservations ['5b8ec8e3-eae9-49ed-81a2-2e33d1764ac3', '68bca3fa-b0ac-4ae4-8781-65d6082e7ad2', '5ba3ea4b-354b-4c76-a618-8367f0711d27', '9ed3f19f-8654-407d-91ac-50d209f8683f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.094s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:34 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:38:34 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Deleted volume successfully.
Sep 23 15:38:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5e386d04-b738-4916-8b8a-91ad8cb9bca7 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-482c54da-5d18-4789-b242-a817fa011ac2-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-ea529970-8e5d-4269-8737-29830c370838-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-ea529970-8e5d-4269-8737-29830c370838-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:35 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "cinder-quobyte-ea529970-8e5d-4269-8737-29830c370838" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ea529970-8e5d-4269-8737-29830c370838" acquired by "delete_volume" :: waited 0.011s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd7700-c6a9-44c8-b281-8c95f0e55e58]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:35 devstack quobyte-client[84024]: System call of process 100797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838" returned: 0 in 0.391s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ea529970-8e5d-4269-8737-29830c370838" returned: 0 in 0.104s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-quobyte-ea529970-8e5d-4269-8737-29830c370838" released by "delete_volume" :: held 0.675s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:35 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Created reservations ['b2e56834-7d33-4faa-9b82-ee9470d9d882', '2432e378-708b-43d2-b079-3d4ff2e831e7', '94a1b242-32e3-48ca-aa86-91167c62b04f', 'b70c310e-5a5a-4ecb-bfbf-780c35d6da3e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.094s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:38:36 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Deleted volume successfully.
Sep 23 15:38:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0d89cf54-e1c1-473b-93fc-f3c6ecb00e11 tempest-SnapshotDependencyTests-162322717 None] Lock "cinder-ea529970-8e5d-4269-8737-29830c370838-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:38:46 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=36,cinder:DELETE=1,cinder:SELECT=18,cinder:INSERT=4 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:38:46 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=21,cinder:UPDATE=17,cinder:DELETE=4,cinder:INSERT=8 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:39:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (2f359904-d8a2-4a97-bcc9-29a5a6b26b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171fc71b-1e4c-4425-a027-1f121e8ea2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171fc71b-1e4c-4425-a027-1f121e8ea2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858523874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fc7b49-38d9-4c50-8179-40ac053738a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:07Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a458b4-086c-4e2d-9ae7-ed950b27d384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a458b4-086c-4e2d-9ae7-ed950b27d384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fb1d9d-b325-4b10-8381-dcf2efb4ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75fb1d9d-b325-4b10-8381-dcf2efb4ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fc7b49-38d9-4c50-8179-40ac053738a3', 'volume_name': 'volume-e0fc7b49-38d9-4c50-8179-40ac053738a3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c701ebad-7ad2-490d-9441-42abeae84736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c701ebad-7ad2-490d-9441-42abeae84736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039a3dfd-db9f-4a7c-8507-52eb0bb8902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:07 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Volume e0fc7b49-38d9-4c50-8179-40ac053738a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fc7b49-38d9-4c50-8179-40ac053738a3', 'volume_size': 1}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858523874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fc7b49-38d9-4c50-8179-40ac053738a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:07Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Creating volume e0fc7b49-38d9-4c50-8179-40ac053738a3 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:07 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:07 devstack quobyte-client[84024]: System call of process 100891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:07 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:07 devstack quobyte-client[84024]: System call of process 100891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:07 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=146, name=volume-e0fc7b49-38d9-4c50-8179-40ac053738a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Flow 'volume_create_manager' (241a106f-c5b0-4211-8632-6186e3d82702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fa7bab-39cb-40b5-bfd8-74b40f53653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fa7bab-39cb-40b5-bfd8-74b40f53653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d1fa08-430e-421d-895d-183ad14f57a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990153fceba4011a44f542edf0e2429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:07Z,use_quota=True,user_id='918937c7aa4f4925acd7469b7f565170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eeca82-9c30-4cfd-899f-e38df278bd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eeca82-9c30-4cfd-899f-e38df278bd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15e7f5a-2617-4aef-b50a-a1507b3f40b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15e7f5a-2617-4aef-b50a-a1507b3f40b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d1fa08-430e-421d-895d-183ad14f57a2', 'volume_name': 'volume-d8d1fa08-430e-421d-895d-183ad14f57a2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9a7839-7bd4-46fc-99dd-9c8a55cd1e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9a7839-7bd4-46fc-99dd-9c8a55cd1e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96faae6-6297-4620-bd2d-12d0bf78d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Volume d8d1fa08-430e-421d-895d-183ad14f57a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d1fa08-430e-421d-895d-183ad14f57a2', 'volume_size': 1}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (00c71a3f-72c9-40cf-8b2d-2d3280b8a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6187b3-ef59-4ce2-8389-f0373e481497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3 1073741824" returned: 0 in 0.933s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (9ca27739-ef5c-45a7-bf57-eb0a19837e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b00aeff-168d-4150-a952-e276dc10f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b00aeff-168d-4150-a952-e276dc10f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-560701445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30b3f71-7d42-4eb3-8307-8616cddb191a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:08Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3664838-f5f3-48cf-9023-11e7d89b5fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3664838-f5f3-48cf-9023-11e7d89b5fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2496b9d-ca34-4a3b-ae96-084ad4376511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2496b9d-ca34-4a3b-ae96-084ad4376511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30b3f71-7d42-4eb3-8307-8616cddb191a', 'volume_name': 'volume-e30b3f71-7d42-4eb3-8307-8616cddb191a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04e60bf-dc4d-480e-b030-158e34797a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04e60bf-dc4d-480e-b030-158e34797a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c95bf6-2946-4873-b674-30d164a51369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Volume e30b3f71-7d42-4eb3-8307-8616cddb191a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30b3f71-7d42-4eb3-8307-8616cddb191a', 'volume_size': 1}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6187b3-ef59-4ce2-8389-f0373e481497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1287353122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba83e2c8-b323-4445-8d08-7ec14131184f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:07Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc60f28-203f-406a-bbb2-78fabd054026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc60f28-203f-406a-bbb2-78fabd054026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cd3753-d270-4d00-8bd4-e3287280a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cd3753-d270-4d00-8bd4-e3287280a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba83e2c8-b323-4445-8d08-7ec14131184f', 'volume_name': 'volume-ba83e2c8-b323-4445-8d08-7ec14131184f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2577d69-ecb3-4a52-8133-9761ef93b57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2577d69-ecb3-4a52-8133-9761ef93b57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89467197-d5dc-46d9-9dac-316b1bb10c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume ba83e2c8-b323-4445-8d08-7ec14131184f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba83e2c8-b323-4445-8d08-7ec14131184f', 'volume_size': 1}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3" returned: 0 in 0.760s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:08 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:08 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (852984d4-d4c2-4ac0-a747-6f428db133de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d37f39d-41b5-419f-8be9-4aa163814521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] <== create_volume: return (1781ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d37f39d-41b5-419f-8be9-4aa163814521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114035376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ec0c2b-6456-4713-a2a6-15c3199bf621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:09Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20c74b1-0e40-4372-a818-8d79b89b49e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20c74b1-0e40-4372-a818-8d79b89b49e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47355989-d4a2-470d-a0da-8d6c72dacb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47355989-d4a2-470d-a0da-8d6c72dacb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ec0c2b-6456-4713-a2a6-15c3199bf621', 'volume_name': 'volume-25ec0c2b-6456-4713-a2a6-15c3199bf621', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5388c923-3339-44eb-9ab7-ed44645fd288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5388c923-3339-44eb-9ab7-ed44645fd288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06d17c5-bfb3-45e7-9ff4-a101ca8d464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:09 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Volume 25ec0c2b-6456-4713-a2a6-15c3199bf621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ec0c2b-6456-4713-a2a6-15c3199bf621', 'volume_size': 1}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114035376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ec0c2b-6456-4713-a2a6-15c3199bf621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:09Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Creating volume 25ec0c2b-6456-4713-a2a6-15c3199bf621 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:09 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:09 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:09 devstack quobyte-client[84024]: System call of process 100897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:09 devstack quobyte-client[84024]: System call of process 100897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:09 devstack quobyte-client[84024]: System call of process 100897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:09 devstack quobyte-client[84024]: System call of process 100897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:09 devstack quobyte-client[84024]: System call of process 100897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:09 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=147, name=volume-25ec0c2b-6456-4713-a2a6-15c3199bf621, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (3706ae96-fc76-41e6-bb33-6252f4cbdc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ea9b81-1f29-4ea0-8fe6-acef16675ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039a3dfd-db9f-4a7c-8507-52eb0bb8902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fc7b49-38d9-4c50-8179-40ac053738a3', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93fd347-217a-4060-9f90-7286ed0ae5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ea9b81-1f29-4ea0-8fe6-acef16675ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624610927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85966689-973e-4e50-81a7-321273c09c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:08Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eaf3d5b-16b5-4c49-80b7-6eee219412c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eaf3d5b-16b5-4c49-80b7-6eee219412c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1af503-8153-4934-9005-7866f7e1117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1af503-8153-4934-9005-7866f7e1117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85966689-973e-4e50-81a7-321273c09c09', 'volume_name': 'volume-85966689-973e-4e50-81a7-321273c09c09', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3ff799-1b6f-4354-978d-9385224ed9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3ff799-1b6f-4354-978d-9385224ed9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770ed825-d18d-479b-b9c7-4727527e57f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Volume 85966689-973e-4e50-81a7-321273c09c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85966689-973e-4e50-81a7-321273c09c09', 'volume_size': 1}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:10 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (368d7711-438f-4ea7-a5d4-5b0838116dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e71dca2-760c-4d43-8c48-68e9cdd0d58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621 1073741824" returned: 0 in 1.257s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Volume volume-e0fc7b49-38d9-4c50-8179-40ac053738a3 (e0fc7b49-38d9-4c50-8179-40ac053738a3): created successfully
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93fd347-217a-4060-9f90-7286ed0ae5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (2f359904-d8a2-4a97-bcc9-29a5a6b26b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e71dca2-760c-4d43-8c48-68e9cdd0d58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576968411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfa5111-8736-46f3-b987-596fcd08985d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:09Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667cd78c-da98-4125-9a89-89f4f7ef9771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667cd78c-da98-4125-9a89-89f4f7ef9771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc8d779-4e18-4731-a09b-cb646120cc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc8d779-4e18-4731-a09b-cb646120cc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfa5111-8736-46f3-b987-596fcd08985d', 'volume_name': 'volume-dcfa5111-8736-46f3-b987-596fcd08985d', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc05cfe6-6a78-4485-b0af-687726287d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc05cfe6-6a78-4485-b0af-687726287d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc86ed5-707b-40cb-afb8-5cb89c06b5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:10 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Volume dcfa5111-8736-46f3-b987-596fcd08985d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfa5111-8736-46f3-b987-596fcd08985d', 'volume_size': 1}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.979s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:10 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-94518316-3841-4a28-9e5c-e1d6c10e8b97 tempest-CreateVolumesFromImageTest-1916445197 None] Created volume successfully.
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621" returned: 0 in 0.518s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] <== create_volume: return (1802ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-560701445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30b3f71-7d42-4eb3-8307-8616cddb191a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:08Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Creating volume e30b3f71-7d42-4eb3-8307-8616cddb191a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:10 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:11 devstack quobyte-client[84024]: System call of process 100902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:11 devstack quobyte-client[84024]: System call of process 100902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:11 devstack quobyte-client[84024]: System call of process 100902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:11 devstack quobyte-client[84024]: System call of process 100902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:11 devstack quobyte-client[84024]: System call of process 100902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:11 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=148, name=volume-e30b3f71-7d42-4eb3-8307-8616cddb191a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06d17c5-bfb3-45e7-9ff4-a101ca8d464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ec0c2b-6456-4713-a2a6-15c3199bf621', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69dde81-1471-44b3-8617-9590de7d312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a 1073741824" returned: 0 in 0.538s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:11 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Volume volume-25ec0c2b-6456-4713-a2a6-15c3199bf621 (25ec0c2b-6456-4713-a2a6-15c3199bf621): created successfully
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69dde81-1471-44b3-8617-9590de7d312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (852984d4-d4c2-4ac0-a747-6f428db133de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a" returned: 0 in 0.333s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] <== create_volume: return (898ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.873s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1287353122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba83e2c8-b323-4445-8d08-7ec14131184f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:07Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Creating volume ba83e2c8-b323-4445-8d08-7ec14131184f {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:11 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:12 devstack quobyte-client[84024]: System call of process 100906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:12 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=149, name=volume-ba83e2c8-b323-4445-8d08-7ec14131184f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c95bf6-2946-4873-b674-30d164a51369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30b3f71-7d42-4eb3-8307-8616cddb191a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b744ece-b8ea-49ba-b73d-4d6bb8154bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e4d02a78-46f1-4ffe-8c83-3ecddc60af7f tempest-CreateVolumesFromImageTest-1916445197 None] Created volume successfully.
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f 1073741824" returned: 0 in 0.480s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:12 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Volume volume-e30b3f71-7d42-4eb3-8307-8616cddb191a (e30b3f71-7d42-4eb3-8307-8616cddb191a): created successfully
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b744ece-b8ea-49ba-b73d-4d6bb8154bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (9ca27739-ef5c-45a7-bf57-eb0a19837e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:12 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7e6e2a67-dc89-46d4-ba92-d85eca2231bf tempest-CreateVolumesFromImageTest-1916445197 None] Created volume successfully.
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f" returned: 0 in 0.403s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] <== create_volume: return (914ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.645s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d1fa08-430e-421d-895d-183ad14f57a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990153fceba4011a44f542edf0e2429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:07Z,use_quota=True,user_id='918937c7aa4f4925acd7469b7f565170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Creating volume d8d1fa08-430e-421d-895d-183ad14f57a2 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:12 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:12 devstack quobyte-client[84024]: System call of process 100910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:12 devstack quobyte-client[84024]: System call of process 100910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=150, name=volume-d8d1fa08-430e-421d-895d-183ad14f57a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89467197-d5dc-46d9-9dac-316b1bb10c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba83e2c8-b323-4445-8d08-7ec14131184f', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ca0ff6-f507-4270-9117-fe9ee3ca17ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:13 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume volume-ba83e2c8-b323-4445-8d08-7ec14131184f (ba83e2c8-b323-4445-8d08-7ec14131184f): created successfully
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ca0ff6-f507-4270-9117-fe9ee3ca17ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (00c71a3f-72c9-40cf-8b2d-2d3280b8a964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2 1073741824" returned: 0 in 0.490s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-66d16cae-bfe3-4a37-9907-c1b6a42b30f2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created volume successfully.
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2" returned: 0 in 0.279s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] <== create_volume: return (798ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1624610927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85966689-973e-4e50-81a7-321273c09c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:08Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Creating volume 85966689-973e-4e50-81a7-321273c09c09 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:13 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:13 devstack quobyte-client[84024]: System call of process 100914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:13 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=151, name=volume-85966689-973e-4e50-81a7-321273c09c09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96faae6-6297-4620-bd2d-12d0bf78d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d1fa08-430e-421d-895d-183ad14f57a2', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e22471-9166-4d78-a295-73c79db34dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09 1073741824" returned: 0 in 0.476s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:14 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Volume volume-d8d1fa08-430e-421d-895d-183ad14f57a2 (d8d1fa08-430e-421d-895d-183ad14f57a2): created successfully
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e22471-9166-4d78-a295-73c79db34dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Flow 'volume_create_manager' (241a106f-c5b0-4211-8632-6186e3d82702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09" returned: 0 in 0.679s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:14 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-390ad443-4aa6-42a8-92b8-927ee8bb6cbd tempest-CinderUnicodeTest-102729043 None] Created volume successfully.
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] <== create_volume: return (1198ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1576968411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfa5111-8736-46f3-b987-596fcd08985d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1d59ad1f849b091f93eb2750822d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:09Z,use_quota=True,user_id='e428900a94844f968eee968b09c26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Creating volume dcfa5111-8736-46f3-b987-596fcd08985d {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:14 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:15 devstack quobyte-client[84024]: System call of process 100918 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:15 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=152, name=volume-dcfa5111-8736-46f3-b987-596fcd08985d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (d208dc4b-8fd7-41c6-9789-f5a9c67e2b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef40bb96-23a4-4c55-bf5f-5eaf0d8c1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770ed825-d18d-479b-b9c7-4727527e57f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85966689-973e-4e50-81a7-321273c09c09', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd80de4c-8acb-44de-a1af-3293d55d1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef40bb96-23a4-4c55-bf5f-5eaf0d8c1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063877963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92aae1f-ba85-4c49-a9d3-750c561e7488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:15Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a74d3c7-a97b-4d1c-bb31-2f770a7435cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a74d3c7-a97b-4d1c-bb31-2f770a7435cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf095e9d-b366-4a37-a940-03bb44b1574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf095e9d-b366-4a37-a940-03bb44b1574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92aae1f-ba85-4c49-a9d3-750c561e7488', 'volume_name': 'volume-a92aae1f-ba85-4c49-a9d3-750c561e7488', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dcb253-1c3a-429c-8e4b-ec3e9daa246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dcb253-1c3a-429c-8e4b-ec3e9daa246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b76a71-613e-4d20-8c0a-94b512914fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:15 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume a92aae1f-ba85-4c49-a9d3-750c561e7488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92aae1f-ba85-4c49-a9d3-750c561e7488', 'volume_size': 1}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:15 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (ff09fd87-cfbb-4685-a530-f35efb0cf90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:15 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e988892-2714-4d04-bb80-0f263bd036dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d 1073741824" returned: 0 in 1.097s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e988892-2714-4d04-bb80-0f263bd036dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324034233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a808b9-3205-491c-8a27-adacc25e9a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:15Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcfc863-fa5a-4fba-9d2a-3316c423e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcfc863-fa5a-4fba-9d2a-3316c423e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0749a6ff-f06c-4097-a584-63cc361d52fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0749a6ff-f06c-4097-a584-63cc361d52fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a808b9-3205-491c-8a27-adacc25e9a1a', 'volume_name': 'volume-c6a808b9-3205-491c-8a27-adacc25e9a1a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad03632-0ece-45bb-a125-a21815e3ece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad03632-0ece-45bb-a125-a21815e3ece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297f4842-2982-486a-b7ad-674cbe6f375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume c6a808b9-3205-491c-8a27-adacc25e9a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a808b9-3205-491c-8a27-adacc25e9a1a', 'volume_size': 1}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Volume volume-85966689-973e-4e50-81a7-321273c09c09 (85966689-973e-4e50-81a7-321273c09c09): created successfully
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd80de4c-8acb-44de-a1af-3293d55d1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (3706ae96-fc76-41e6-bb33-6252f4cbdc1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ac267746-f4bc-447a-9247-1fa3237a7449 tempest-CreateVolumesFromImageTest-1916445197 None] Created volume successfully.
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d" returned: 0 in 0.665s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:16 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (0e6849e6-ba2a-4b9c-be40-607ee04ab7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a846d63-354d-461e-a339-3d67b5499376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] <== create_volume: return (2015ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a846d63-354d-461e-a339-3d67b5499376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655332995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad25a02f-c2ef-4331-9c3b-4668bf37e6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:16Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abde52c9-55a7-4b62-acfa-6e5c5ade4033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abde52c9-55a7-4b62-acfa-6e5c5ade4033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb65707-47ce-422e-857c-dbbb1afbd273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb65707-47ce-422e-857c-dbbb1afbd273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad25a02f-c2ef-4331-9c3b-4668bf37e6da', 'volume_name': 'volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb170d22-6c6a-442f-8208-e704dd36fc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb170d22-6c6a-442f-8208-e704dd36fc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88108384-662d-4466-8544-4a8f24c86827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:16 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume ad25a02f-c2ef-4331-9c3b-4668bf37e6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da', 'volume_size': 1}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-655332995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad25a02f-c2ef-4331-9c3b-4668bf37e6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:16Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Creating volume ad25a02f-c2ef-4331-9c3b-4668bf37e6da {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:16 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:17 devstack quobyte-client[84024]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:17 devstack quobyte-client[84024]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:17 devstack quobyte-client[84024]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:17 devstack quobyte-client[84024]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:17 devstack quobyte-client[84024]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:17 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=153, name=volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (2609e8da-78ba-46cf-bf4c-ad87ddf0e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d847be-8c5d-481e-80be-4c211e4b1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Flow 'volume_create_manager' (9825695b-bd4a-4fc0-b0de-758aa95415e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9914a79-a4fb-4aca-b5dc-ca038ef8d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d847be-8c5d-481e-80be-4c211e4b1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548324621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46f9048-11d1-470a-9956-6f2ecc4c4241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:16Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a84d7be-c7b2-47ba-a02d-f0df23b72fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a84d7be-c7b2-47ba-a02d-f0df23b72fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516e3945-d748-456b-b3d4-a32ad91feefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516e3945-d748-456b-b3d4-a32ad91feefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46f9048-11d1-470a-9956-6f2ecc4c4241', 'volume_name': 'volume-b46f9048-11d1-470a-9956-6f2ecc4c4241', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44117d6-d5df-4bea-a2e6-a48ad9c91d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44117d6-d5df-4bea-a2e6-a48ad9c91d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b93b8ab-6a79-4898-800d-265b4c2f133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume b46f9048-11d1-470a-9956-6f2ecc4c4241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46f9048-11d1-470a-9956-6f2ecc4c4241', 'volume_size': 1}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc86ed5-707b-40cb-afb8-5cb89c06b5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfa5111-8736-46f3-b987-596fcd08985d', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f91eb4-fdcb-4818-9165-a92ffff3d2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da 1073741824" returned: 0 in 0.766s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:17 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (b03fb445-14ad-4837-8af6-2d9316f092c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd81909-019b-4f89-899e-64d66b3e9aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd81909-019b-4f89-899e-64d66b3e9aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32573561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74115eb1-5114-4a93-9890-65674b9f3f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:17Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f0ca2-2656-4fe8-b74e-e9a006e18180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f0ca2-2656-4fe8-b74e-e9a006e18180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4bac55-cd78-4ea2-83b0-6cfdae9b8f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4bac55-cd78-4ea2-83b0-6cfdae9b8f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74115eb1-5114-4a93-9890-65674b9f3f6b', 'volume_name': 'volume-74115eb1-5114-4a93-9890-65674b9f3f6b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9912f0be-959b-4a62-b545-9cc4e501a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9912f0be-959b-4a62-b545-9cc4e501a004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcdacef-b1d6-4f4f-91f8-4702c7d8d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume 74115eb1-5114-4a93-9890-65674b9f3f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74115eb1-5114-4a93-9890-65674b9f3f6b', 'volume_size': 1}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Volume volume-dcfa5111-8736-46f3-b987-596fcd08985d (dcfa5111-8736-46f3-b987-596fcd08985d): created successfully
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f91eb4-fdcb-4818-9165-a92ffff3d2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Flow 'volume_create_manager' (368d7711-438f-4ea7-a5d4-5b0838116dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9914a79-a4fb-4aca-b5dc-ca038ef8d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1425236487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14909df7-fffb-4ef6-9381-b4cc70692c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990153fceba4011a44f542edf0e2429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:16Z,use_quota=True,user_id='918937c7aa4f4925acd7469b7f565170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2db1614-758d-4248-a0bc-2e1ee8f9ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2db1614-758d-4248-a0bc-2e1ee8f9ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015ba307-333e-47de-beb0-681714a6f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015ba307-333e-47de-beb0-681714a6f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14909df7-fffb-4ef6-9381-b4cc70692c32', 'volume_name': 'volume-14909df7-fffb-4ef6-9381-b4cc70692c32', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4dad33-32f4-4266-9ef9-dd463188530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4dad33-32f4-4266-9ef9-dd463188530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92845904-5a13-405c-a093-80c6f0cdbdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Volume 14909df7-fffb-4ef6-9381-b4cc70692c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14909df7-fffb-4ef6-9381-b4cc70692c32', 'volume_size': 1}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da" returned: 0 in 0.636s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] <== create_volume: return (1428ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324034233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a808b9-3205-491c-8a27-adacc25e9a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:15Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Creating volume c6a808b9-3205-491c-8a27-adacc25e9a1a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:18 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:18 devstack quobyte-client[84024]: System call of process 100927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:18 devstack quobyte-client[84024]: System call of process 100927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:18 devstack quobyte-client[84024]: System call of process 100927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:18 devstack quobyte-client[84024]: System call of process 100927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:18 devstack quobyte-client[84024]: System call of process 100927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:18 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=154, name=volume-c6a808b9-3205-491c-8a27-adacc25e9a1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:18 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-3d268378-fd84-4218-bcbc-91801a897211 tempest-CreateVolumesFromImageTest-1916445197 None] Created volume successfully.
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88108384-662d-4466-8544-4a8f24c86827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e341d970-93dc-4ff3-9f95-1587e81c103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:18 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da (ad25a02f-c2ef-4331-9c3b-4668bf37e6da): created successfully
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e341d970-93dc-4ff3-9f95-1587e81c103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:18 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (0e6849e6-ba2a-4b9c-be40-607ee04ab7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a 1073741824" returned: 0 in 0.571s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-dcfa5111-8736-46f3-b987-596fcd08985d-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:19 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e439c94e-c6c3-450d-a937-3d244377537f tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created volume successfully.
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a" returned: 0 in 0.427s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] <== create_volume: return (1027ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-dcfa5111-8736-46f3-b987-596fcd08985d-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.597s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2063877963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92aae1f-ba85-4c49-a9d3-750c561e7488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:15Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Creating volume a92aae1f-ba85-4c49-a9d3-750c561e7488 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:19 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:19 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=155, name=volume-a92aae1f-ba85-4c49-a9d3-750c561e7488, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:19 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297f4842-2982-486a-b7ad-674cbe6f375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a808b9-3205-491c-8a27-adacc25e9a1a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d334269-e87b-442d-a227-caf4614a46a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:20 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume volume-c6a808b9-3205-491c-8a27-adacc25e9a1a (c6a808b9-3205-491c-8a27-adacc25e9a1a): created successfully
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d334269-e87b-442d-a227-caf4614a46a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (ff09fd87-cfbb-4685-a530-f35efb0cf90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:20 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-quobyte-dcfa5111-8736-46f3-b987-596fcd08985d" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488 1073741824" returned: 0 in 0.595s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:20 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-328352b9-1b41-494e-be4c-7df2b2a16d11 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created volume successfully.
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488" returned: 0 in 0.345s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-dcfa5111-8736-46f3-b987-596fcd08985d" acquired by "delete_volume" :: waited 0.419s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548324621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46f9048-11d1-470a-9956-6f2ecc4c4241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:16Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Creating volume b46f9048-11d1-470a-9956-6f2ecc4c4241 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:20 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:20 devstack quobyte-client[84024]: System call of process 100935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:20 devstack quobyte-client[84024]: System call of process 100935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:20 devstack quobyte-client[84024]: System call of process 100935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:20 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=156, name=volume-b46f9048-11d1-470a-9956-6f2ecc4c4241, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ae6f1-3127-4d0d-b182-b9841772b86e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b76a71-613e-4d20-8c0a-94b512914fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92aae1f-ba85-4c49-a9d3-750c561e7488', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f606cc-59ef-44dd-a268-bc69b1c0cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241 1073741824" returned: 0 in 0.705s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:21 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume volume-a92aae1f-ba85-4c49-a9d3-750c561e7488 (a92aae1f-ba85-4c49-a9d3-750c561e7488): created successfully
Sep 23 15:39:21 devstack quobyte-client[84024]: System call of process 100938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:21 devstack quobyte-client[84024]: System call of process 100938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:21 devstack quobyte-client[84024]: System call of process 100938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:21 devstack quobyte-client[84024]: System call of process 100938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f606cc-59ef-44dd-a268-bc69b1c0cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (d208dc4b-8fd7-41c6-9789-f5a9c67e2b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d" returned: 0 in 0.917s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241" returned: 0 in 0.464s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:21 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ecfe84dd-828f-4c6a-9be2-1924335fb366 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created volume successfully.
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] <== create_volume: return (1289ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.814s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-32573561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74115eb1-5114-4a93-9890-65674b9f3f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0e22224009454081b82adf0bb872bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:17Z,use_quota=True,user_id='05f3ce4be9014d8ea39b069afc74205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Creating volume 74115eb1-5114-4a93-9890-65674b9f3f6b {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:22 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:22 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=157, name=volume-74115eb1-5114-4a93-9890-65674b9f3f6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b93b8ab-6a79-4898-800d-265b4c2f133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46f9048-11d1-470a-9956-6f2ecc4c4241', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c65105a-984e-4a8b-bb60-d37279481f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-dcfa5111-8736-46f3-b987-596fcd08985d" returned: 0 in 0.777s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:22 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume volume-b46f9048-11d1-470a-9956-6f2ecc4c4241 (b46f9048-11d1-470a-9956-6f2ecc4c4241): created successfully
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c65105a-984e-4a8b-bb60-d37279481f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (2609e8da-78ba-46cf-bf4c-ad87ddf0e013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-dcfa5111-8736-46f3-b987-596fcd08985d" released by "delete_volume" :: held 2.184s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:22 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c0d43678-c7f2-4bde-976a-f0e35c609381 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created volume successfully.
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b 1073741824" returned: 0 in 0.645s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b" returned: 0 in 0.323s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] <== create_volume: return (1017ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1425236487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14909df7-fffb-4ef6-9381-b4cc70692c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5990153fceba4011a44f542edf0e2429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:16Z,use_quota=True,user_id='918937c7aa4f4925acd7469b7f565170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Creating volume 14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:23 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:23 devstack quobyte-client[84024]: System call of process 100947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:23 devstack quobyte-client[84024]: System call of process 100947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:23 devstack quobyte-client[84024]: System call of process 100947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:23 devstack quobyte-client[84024]: System call of process 100947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:23 devstack quobyte-client[84024]: System call of process 100947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:23 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=158, name=volume-14909df7-fffb-4ef6-9381-b4cc70692c32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcdacef-b1d6-4f4f-91f8-4702c7d8d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74115eb1-5114-4a93-9890-65674b9f3f6b', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717994bd-33d3-4ec2-9611-e42720a3827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:23 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume volume-74115eb1-5114-4a93-9890-65674b9f3f6b (74115eb1-5114-4a93-9890-65674b9f3f6b): created successfully
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717994bd-33d3-4ec2-9611-e42720a3827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Flow 'volume_create_manager' (b03fb445-14ad-4837-8af6-2d9316f092c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 1073741824" returned: 0 in 0.531s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:23 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d5f5c4d8-5eec-4f33-b6ac-e011c5ce69da tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created volume successfully.
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32" returned: 0 in 0.306s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] <== create_volume: return (867ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Created reservations ['031cc003-0636-4d18-bc35-3a5576f778cf', '1db80c9a-134d-4988-8ce7-a672a21728b0', '1de06063-355a-4875-9391-bb330fe5c9b3', 'd65e7215-3e33-45c2-86a9-bd7bb1c3b34f'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92845904-5a13-405c-a093-80c6f0cdbdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14909df7-fffb-4ef6-9381-b4cc70692c32', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c099b8e6-e368-43b1-8bda-47f2393eddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:24 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Volume volume-14909df7-fffb-4ef6-9381-b4cc70692c32 (14909df7-fffb-4ef6-9381-b4cc70692c32): created successfully
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c099b8e6-e368-43b1-8bda-47f2393eddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Flow 'volume_create_manager' (9825695b-bd4a-4fc0-b0de-758aa95415e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:24 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5c50fb36-82f6-487a-8235-1dab9b61b06a tempest-CinderUnicodeTest-102729043 None] Created volume successfully.
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-74115eb1-5114-4a93-9890-65674b9f3f6b-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.199s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:24 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Deleted volume successfully.
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-74115eb1-5114-4a93-9890-65674b9f3f6b-delete_volume" acquired by "delete_volume" :: waited 0.425s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7361f9cd-f3a6-43e4-8496-8ca9f39542ab tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-dcfa5111-8736-46f3-b987-596fcd08985d-delete_volume" released by "delete_volume" :: held 5.409s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:24 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-25ec0c2b-6456-4713-a2a6-15c3199bf621-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:24 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-quobyte-74115eb1-5114-4a93-9890-65674b9f3f6b" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-25ec0c2b-6456-4713-a2a6-15c3199bf621-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-74115eb1-5114-4a93-9890-65674b9f3f6b" acquired by "delete_volume" :: waited 0.036s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cc973c-6d43-450b-8483-f9b2aecc5665]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-quobyte-25ec0c2b-6456-4713-a2a6-15c3199bf621" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:25 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:25 devstack quobyte-client[84024]: System call of process 100952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:25 devstack quobyte-client[84024]: System call of process 100952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:25 devstack quobyte-client[84024]: System call of process 100952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Creating offline snapshot 914c8dad-edd4-4a0f-8b4d-fff4b6330309 of volume 14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-25ec0c2b-6456-4713-a2a6-15c3199bf621" acquired by "delete_volume" :: waited 0.125s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acb6d73-8c69-4a60-813e-7a248e8237b8]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb7fe49-a9d1-4879-a61c-bbe0b2382151]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b" returned: 0 in 0.869s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-74115eb1-5114-4a93-9890-65674b9f3f6b" returned: 0 in 0.199s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:26 devstack quobyte-client[84024]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:26 devstack quobyte-client[84024]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:26 devstack quobyte-client[84024]: System call of process 100955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-74115eb1-5114-4a93-9890-65674b9f3f6b" released by "delete_volume" :: held 1.291s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32" returned: 0 in 0.842s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:26 devstack quobyte-client[84024]: System call of process 100956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:26 devstack quobyte-client[84024]: System call of process 100956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:26 devstack quobyte-client[84024]: System call of process 100961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:26 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=159, name=volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621" returned: 0 in 1.063s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 1G" returned: 0 in 0.472s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): qemu-img rebase -u -b volume-14909df7-fffb-4ef6-9381-b4cc70692c32 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:27 devstack quobyte-client[84024]: System call of process 100966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created reservations ['295ff10d-aeed-41ac-8b4e-50747532882b', '469c5056-2213-48f0-9d8c-09f94fc6f254', '0fbbced5-2a65-4c25-ab56-9d8e86c7e838', '4bb7b144-cf6b-47f5-a3d7-282c33d22cd6'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-25ec0c2b-6456-4713-a2a6-15c3199bf621" returned: 0 in 0.592s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "qemu-img rebase -u -b volume-14909df7-fffb-4ef6-9381-b4cc70692c32 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309" returned: 0 in 0.408s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:27 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-b46f9048-11d1-470a-9956-6f2ecc4c4241-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-25ec0c2b-6456-4713-a2a6-15c3199bf621" released by "delete_volume" :: held 2.405s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309" returned: 0 in 0.500s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-b46f9048-11d1-470a-9956-6f2ecc4c4241-delete_volume" acquired by "delete_volume" :: waited 0.514s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309" returned: 0 in 0.431s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.info" returned: 0 in 0.753s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:29 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-quobyte-b46f9048-11d1-470a-9956-6f2ecc4c4241" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Created reservations ['b992d6e8-fee7-477a-b82b-00f2bd4f2933', 'c33ebb76-ba4e-4a60-9622-fc15bb29882d', 'b5cd04d6-dd94-4fea-8f8c-c1a554451b6b', 'ed055ce7-8ccd-4c30-902b-728bcced4708'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.848s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.info" returned: 0 in 0.407s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.295s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:29 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Deleted volume successfully.
Sep 23 15:39:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-b46f9048-11d1-470a-9956-6f2ecc4c4241" acquired by "delete_volume" :: waited 0.556s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80388d-8d96-4f12-b8b4-380deb5b9154]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-04375a0d-4291-4149-9a2f-8ad36ca9f9b5 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-74115eb1-5114-4a93-9890-65674b9f3f6b-delete_volume" released by "delete_volume" :: held 5.460s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b05ad9d9-d51f-495d-bcd1-260b07f039ca tempest-CinderUnicodeTest-102729043 None] Create snapshot completed successfully
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-914c8dad-edd4-4a0f-8b4d-fff4b6330309-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-85966689-973e-4e50-81a7-321273c09c09-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:30 devstack quobyte-client[84024]: System call of process 100975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-85966689-973e-4e50-81a7-321273c09c09-delete_volume" acquired by "delete_volume" :: waited 0.362s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-914c8dad-edd4-4a0f-8b4d-fff4b6330309-delete_snapshot" acquired by "delete_snapshot" :: waited 0.648s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-quobyte-14909df7-fffb-4ef6-9381-b4cc70692c32" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241" returned: 0 in 1.175s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.709s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-14909df7-fffb-4ef6-9381-b4cc70692c32" acquired by "delete_snapshot" :: waited 0.494s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-quobyte-914c8dad-edd4-4a0f-8b4d-fff4b6330309" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:31 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Deleted volume successfully.
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-b46f9048-11d1-470a-9956-6f2ecc4c4241" returned: 0 in 0.539s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:31 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-quobyte-85966689-973e-4e50-81a7-321273c09c09" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-b46f9048-11d1-470a-9956-6f2ecc4c4241" released by "delete_volume" :: held 1.867s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-914c8dad-edd4-4a0f-8b4d-fff4b6330309" acquired by "_delete_snapshot" :: waited 0.164s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Deleting offline snapshot 914c8dad-edd4-4a0f-8b4d-fff4b6330309 of volume 14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] snapshot_file for this snap is: volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74484051-3aa1-4287-b083-83d8d664db80]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-85966689-973e-4e50-81a7-321273c09c09" acquired by "delete_volume" :: waited 0.105s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c17ef-6fa9-4a8b-9ec0-2233d67c42db]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b6dbbfd6-3f68-421f-8c2d-4ec20afc0ede tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-25ec0c2b-6456-4713-a2a6-15c3199bf621-delete_volume" released by "delete_volume" :: held 7.204s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309" returned: 0 in 0.767s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14909df7-fffb-4ef6-9381-b4cc70692c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created reservations ['c3390a1e-fa85-4242-ba3e-3c44533b0d77', '45ab2336-dcfc-4517-ad8b-8b36cb25aacf', '6a3a0988-5c32-448f-b13a-50a903bbcc47', '23049d6a-36e7-48c6-bc37-11ef696ea64e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[56209494-3602-4b55-ada9-0144054f86ee]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:32 devstack quobyte-client[84024]: System call of process 100987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:32 devstack quobyte-client[84024]: System call of process 100987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09" returned: 0 in 1.017s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:33 devstack quobyte-client[84024]: System call of process 100991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:33 devstack quobyte-client[84024]: System call of process 100991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:33 devstack quobyte-client[84024]: System call of process 100991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-ad25a02f-c2ef-4331-9c3b-4668bf37e6da-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-85966689-973e-4e50-81a7-321273c09c09" returned: 0 in 0.505s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32" returned: 0 in 1.013s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:34 devstack quobyte-client[84024]: System call of process 100996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-ad25a02f-c2ef-4331-9c3b-4668bf37e6da-delete_volume" acquired by "delete_volume" :: waited 0.270s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-85966689-973e-4e50-81a7-321273c09c09" released by "delete_volume" :: held 2.328s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309" returned: 0 in 0.885s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.538s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:35 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Deleted volume successfully.
Sep 23 15:39:35 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-quobyte-ad25a02f-c2ef-4331-9c3b-4668bf37e6da" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32.914c8dad-edd4-4a0f-8b4d-fff4b6330309" returned: 0 in 0.571s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-914c8dad-edd4-4a0f-8b4d-fff4b6330309" released by "_delete_snapshot" :: held 3.587s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-c99e563f-1b31-4809-9eca-96ac2012456c tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-b46f9048-11d1-470a-9956-6f2ecc4c4241-delete_volume" released by "delete_volume" :: held 6.956s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-ad25a02f-c2ef-4331-9c3b-4668bf37e6da" acquired by "delete_volume" :: waited 0.085s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Created reservations ['1809f028-e718-4deb-8265-26abe9f9c579', 'e7b3730d-7db4-477b-86f0-0253f6969b26', 'ca4111f3-0b0a-48e4-a047-12794bbb96a9', '930cb91b-689d-4829-88e7-e08e463b317e'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-14909df7-fffb-4ef6-9381-b4cc70692c32" released by "delete_snapshot" :: held 3.815s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8c7b2d-2cf8-4ac7-9c09-cfc49e8b6908]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da" returned: 0 in 0.641s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Created reservations ['cb0642d5-951a-44c6-b37e-9c960c1c6409', '1d9d0117-6db8-4f93-980d-5823e83d20e9', '833d211a-54fb-48a0-9aa3-c71cf497e183', 'e7f782ed-4f26-49b4-a986-8c7ca094d765'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-e30b3f71-7d42-4eb3-8307-8616cddb191a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ad25a02f-c2ef-4331-9c3b-4668bf37e6da" returned: 0 in 0.506s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-14909df7-fffb-4ef6-9381-b4cc70692c32-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-ad25a02f-c2ef-4331-9c3b-4668bf37e6da" released by "delete_volume" :: held 1.753s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-e30b3f71-7d42-4eb3-8307-8616cddb191a-delete_volume" acquired by "delete_volume" :: waited 0.635s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.546s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-14909df7-fffb-4ef6-9381-b4cc70692c32-delete_volume" acquired by "delete_volume" :: waited 0.183s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:37 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Deleted volume successfully.
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-01c7e0af-69ae-41a0-b01f-37be68abf3ba tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-85966689-973e-4e50-81a7-321273c09c09-delete_volume" released by "delete_volume" :: held 6.379s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:37 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Delete snapshot completed successfully.
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-b876f21b-32a6-41b1-ac2a-c8f0af57f076 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-914c8dad-edd4-4a0f-8b4d-fff4b6330309-delete_snapshot" released by "delete_snapshot" :: held 6.317s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-quobyte-e30b3f71-7d42-4eb3-8307-8616cddb191a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:37 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-quobyte-14909df7-fffb-4ef6-9381-b4cc70692c32" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-e30b3f71-7d42-4eb3-8307-8616cddb191a" acquired by "delete_volume" :: waited 0.039s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-14909df7-fffb-4ef6-9381-b4cc70692c32" acquired by "delete_volume" :: waited 0.050s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e50db-ed3e-4083-80ac-ff1fe92c7e3e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a87fb5-cd21-44cf-a722-b0631a54c801]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created reservations ['454afae9-442d-48f2-ad32-5d54c1080933', '3695a601-ad8c-43b8-9f81-c17d7323a4bb', 'ebc1685a-c696-4fd6-88e8-46160a4c9d9e', '8f3a5ef7-c8b1-4c0a-9017-9e14154076af'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:38 devstack quobyte-client[84024]: System call of process 101006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:38 devstack quobyte-client[84024]: System call of process 101006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:38 devstack quobyte-client[84024]: System call of process 101006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a" returned: 0 in 0.737s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:38 devstack quobyte-client[84024]: System call of process 101007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:38 devstack quobyte-client[84024]: System call of process 101007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e30b3f71-7d42-4eb3-8307-8616cddb191a" returned: 0 in 0.412s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32" returned: 0 in 0.934s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-e30b3f71-7d42-4eb3-8307-8616cddb191a" released by "delete_volume" :: held 1.545s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-c6a808b9-3205-491c-8a27-adacc25e9a1a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-14909df7-fffb-4ef6-9381-b4cc70692c32" returned: 0 in 0.658s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-14909df7-fffb-4ef6-9381-b4cc70692c32" released by "delete_volume" :: held 2.286s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:39 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-c6a808b9-3205-491c-8a27-adacc25e9a1a-delete_volume" acquired by "delete_volume" :: waited 0.479s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.545s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:40 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Deleted volume successfully.
Sep 23 15:39:40 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-quobyte-c6a808b9-3205-491c-8a27-adacc25e9a1a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Created reservations ['964cc1bd-f137-4ab2-887d-7edd3cc38dc1', '5c805600-7772-4510-b020-55f6b5f4bbc1', 'f0ca7e9b-c91e-4787-8847-53a1234c9a02', '7db6aec6-f49f-48f2-81ef-e3568668a4b8'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-c6a808b9-3205-491c-8a27-adacc25e9a1a" acquired by "delete_volume" :: waited 0.059s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[011cf345-55a2-4c4a-990b-b3b4eb1db06e]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-4cf6a3c7-dd0e-41c0-9b77-dfc34a25b630 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-ad25a02f-c2ef-4331-9c3b-4668bf37e6da-delete_volume" released by "delete_volume" :: held 6.462s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Created reservations ['ee115b10-8047-4e66-a83d-ba645cc61427', '29d21bae-1791-4f00-86f9-ab7b08fa48ce', '7b66695f-8039-4e74-b89d-0e02d9bb6446', '59969e4d-03ec-44d5-bd40-d6fb370dcaac'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:40 devstack quobyte-client[84024]: System call of process 101016 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-e0fc7b49-38d9-4c50-8179-40ac053738a3-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.529s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a" returned: 0 in 1.091s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Deleted volume successfully.
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-e0fc7b49-38d9-4c50-8179-40ac053738a3-delete_volume" acquired by "delete_volume" :: waited 0.554s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-d8d1fa08-430e-421d-895d-183ad14f57a2-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-c6a808b9-3205-491c-8a27-adacc25e9a1a" returned: 0 in 0.538s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-87ad75fa-a161-4548-87f9-aa4f2bc2bd99 tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-e30b3f71-7d42-4eb3-8307-8616cddb191a-delete_volume" released by "delete_volume" :: held 4.690s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-c6a808b9-3205-491c-8a27-adacc25e9a1a" released by "delete_volume" :: held 1.911s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-d8d1fa08-430e-421d-895d-183ad14f57a2-delete_volume" acquired by "delete_volume" :: waited 0.464s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "cinder-quobyte-e0fc7b49-38d9-4c50-8179-40ac053738a3" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.536s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:42 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Deleted volume successfully.
Sep 23 15:39:42 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "cinder-quobyte-d8d1fa08-430e-421d-895d-183ad14f57a2" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-00239a0d-a1ef-4105-8796-a59953875b31 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-14909df7-fffb-4ef6-9381-b4cc70692c32-delete_volume" released by "delete_volume" :: held 5.260s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-e0fc7b49-38d9-4c50-8179-40ac053738a3" acquired by "delete_volume" :: waited 0.125s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[705583f9-42d3-4fd2-bbec-a811fe73af21]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:42 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-d8d1fa08-430e-421d-895d-183ad14f57a2" acquired by "delete_volume" :: waited 0.259s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8625bd-f807-4a04-8d6b-3b67f6f5578b]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:43 devstack quobyte-client[84024]: System call of process 101022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:43 devstack quobyte-client[84024]: System call of process 101022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created reservations ['3d987e45-685a-4b4c-b57f-5c27e60eb783', '0e8243d1-3366-4d75-8203-82feef04bb81', '29b86a93-01c0-4683-b608-95d84dc40811', '834fc495-f9ad-41a9-b70f-8b0a502f8fa8'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3" returned: 0 in 0.799s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:43 devstack quobyte-client[84024]: System call of process 101023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:43 devstack quobyte-client[84024]: System call of process 101023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:43 devstack quobyte-client[84024]: System call of process 101023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-e0fc7b49-38d9-4c50-8179-40ac053738a3" returned: 0 in 0.337s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2" returned: 0 in 0.870s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:43 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-quobyte-e0fc7b49-38d9-4c50-8179-40ac053738a3" released by "delete_volume" :: held 1.555s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-d8d1fa08-430e-421d-895d-183ad14f57a2" returned: 0 in 0.377s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-quobyte-d8d1fa08-430e-421d-895d-183ad14f57a2" released by "delete_volume" :: held 1.522s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.297s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:44 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Deleted volume successfully.
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Created reservations ['bc016fc0-0163-4bbc-8476-36a064736766', 'd399c739-e304-4d00-95d5-fca6b997edd7', '415ac976-c6d1-4a05-94a0-c85c91a1ac02', 'f8e0a8f7-e7e2-462d-b60d-32d333eb2dca'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:44 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Created reservations ['eebc7208-0d0b-46a2-b4ab-c62562abcbb0', 'ee9cbf24-685f-411b-9902-410262568483', '942b1187-fe55-412a-a304-edc7580c0702', 'b71cff23-2bb9-4e07-85e4-cd2b713e6799'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-0a2973fb-5340-4957-941d-cf6c5f9051df tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-c6a808b9-3205-491c-8a27-adacc25e9a1a-delete_volume" released by "delete_volume" :: held 5.100s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-a92aae1f-ba85-4c49-a9d3-750c561e7488-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-a92aae1f-ba85-4c49-a9d3-750c561e7488-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:45 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-quobyte-a92aae1f-ba85-4c49-a9d3-750c561e7488" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.299s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:45 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Deleted volume successfully.
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-a92aae1f-ba85-4c49-a9d3-750c561e7488" acquired by "delete_volume" :: waited 0.462s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d49dc-0730-4fd7-8d92-8d2c37692dac]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:45 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-eefee71f-962f-4105-8475-d63370597e0e tempest-CreateVolumesFromImageTest-1916445197 None] Lock "cinder-e0fc7b49-38d9-4c50-8179-40ac053738a3-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.300s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:46 devstack quobyte-client[84024]: System call of process 101032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:46 devstack quobyte-client[84024]: System call of process 101032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:46 devstack quobyte-client[84024]: System call of process 101032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:46 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Deleted volume successfully.
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488" returned: 0 in 0.938s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:46 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-e8301717-7932-483f-bf55-b87d28c4cb17 tempest-CinderUnicodeTest-102729043 None] Lock "cinder-d8d1fa08-430e-421d-895d-183ad14f57a2-delete_volume" released by "delete_volume" :: held 4.734s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:47 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-a92aae1f-ba85-4c49-a9d3-750c561e7488" returned: 0 in 0.437s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:47 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-a92aae1f-ba85-4c49-a9d3-750c561e7488" released by "delete_volume" :: held 1.497s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:47 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created reservations ['810835aa-08e9-4929-aeaa-e5b58ddbed01', 'b2a63b65-7a80-4fd0-ba45-116fad3b93ba', 'd0a9d2db-0688-491b-8190-be0c1f6cd875', 'ac4bdb83-3d2d-4c83-8038-a3cc75837247'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.234s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:48 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:48 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Deleted volume successfully.
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-ba83e2c8-b323-4445-8d08-7ec14131184f-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-ba83e2c8-b323-4445-8d08-7ec14131184f-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f22b9bd4-b945-44da-9b95-552c24fb98d2 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-a92aae1f-ba85-4c49-a9d3-750c561e7488-delete_volume" released by "delete_volume" :: held 4.591s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:49 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "cinder-quobyte-ba83e2c8-b323-4445-8d08-7ec14131184f" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-ba83e2c8-b323-4445-8d08-7ec14131184f" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd4f36c-1686-47dd-a12b-04311ffa9c0a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:50 devstack quobyte-client[84024]: System call of process 101075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f" returned: 0 in 0.671s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:50 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-ba83e2c8-b323-4445-8d08-7ec14131184f" returned: 0 in 0.178s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-quobyte-ba83e2c8-b323-4445-8d08-7ec14131184f" released by "delete_volume" :: held 1.219s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Created reservations ['0321f4f0-6603-4d1a-a3d9-8c56e5b68ba3', '6f8ec091-9f94-41b5-b7d0-b688fca24dab', '1d2fd63d-a5fa-4324-8aa3-d7d7ac4d11bd', '7c25eaf2-4d7b-4f96-bb3b-844061d4299d'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.203s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:52 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:39:52 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Deleted volume successfully.
Sep 23 15:39:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6ff9cbb0-7a2d-4967-86df-5457925a4bf9 tempest-CreateVolumesFromSourceVolumeTest-2128061980 None] Lock "cinder-ba83e2c8-b323-4445-8d08-7ec14131184f-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:39:52 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:52 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (3f48e14d-c5f8-45b1-b9a5-c22c6d55dbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b82f144-61fd-44d2-849d-83baad7b0491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b82f144-61fd-44d2-849d-83baad7b0491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410416235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ff1870-132f-4c43-8ac9-3adf92be4bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:53Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2ef247-c933-4af2-b3bb-bce94fca936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2ef247-c933-4af2-b3bb-bce94fca936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e07215-a2f3-40a4-9517-74dcb29b7427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e07215-a2f3-40a4-9517-74dcb29b7427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ff1870-132f-4c43-8ac9-3adf92be4bf8', 'volume_name': 'volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a9aa0c-15cb-48d6-9220-27ea69f551a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a9aa0c-15cb-48d6-9220-27ea69f551a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b025dd2-b702-4217-b04a-067965e504f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:53 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume 22ff1870-132f-4c43-8ac9-3adf92be4bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8', 'volume_size': 1}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410416235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ff1870-132f-4c43-8ac9-3adf92be4bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:53Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating volume 22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:53 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:53 devstack quobyte-client[84024]: System call of process 101080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:53 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=161, name=volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 1073741824" returned: 0 in 0.504s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8" returned: 0 in 0.166s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] <== create_volume: return (789ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:39:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b025dd2-b702-4217-b04a-067965e504f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469e3902-bb73-437f-b5de-afb961133a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:54 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 (22ff1870-132f-4c43-8ac9-3adf92be4bf8): created successfully
Sep 23 15:39:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469e3902-bb73-437f-b5de-afb961133a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:54 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (3f48e14d-c5f8-45b1-b9a5-c22c6d55dbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:54 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e59e3b9f-03f2-422d-bcee-d0ff1fb28d4d tempest-CreateVolumesFromSnapshotTest-57012649 None] Created volume successfully.
Sep 23 15:39:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:55 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating offline snapshot a959b6f3-4a11-4ac2-a79f-0d535819bd1b of volume 22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:39:55 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c58a8c-ca68-403a-92d3-9ddb1454f4c0]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:39:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:55 devstack quobyte-client[84024]: System call of process 101084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:55 devstack quobyte-client[84024]: System call of process 101084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8" returned: 0 in 0.572s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:56 devstack quobyte-client[84024]: System call of process 101087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack quobyte-client[84024]: System call of process 101087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack quobyte-client[84024]: System call of process 101087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack quobyte-client[84024]: System call of process 101087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack quobyte-client[84024]: System call of process 101087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack quobyte-client[84024]: System call of process 101087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:56 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=162, name=volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b 1G" returned: 0 in 0.413s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img rebase -u -b volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img rebase -u -b volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b" returned: 0 in 0.232s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:39:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b" returned: 0 in 0.146s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b" returned: 0 in 0.157s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.info" returned: 0 in 0.192s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.info" returned: 0 in 0.243s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:39:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:58 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-e2981488-846c-4993-bfb2-26bb1829d52f tempest-CreateVolumesFromSnapshotTest-57012649 None] Create snapshot completed successfully
Sep 23 15:39:59 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (857ba0cd-b773-4726-9054-ff07acec2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4f57f4-f441-43d1-98d8-4b6b3a36b185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4f57f4-f441-43d1-98d8-4b6b3a36b185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305381479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d005cc1-3258-460b-81af-6f4b88a95c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:59Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686386d3-b2a4-4088-8543-45f3fdd6cc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686386d3-b2a4-4088-8543-45f3fdd6cc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2770fd28-39b8-4eb3-b6f7-ad519fbebfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2770fd28-39b8-4eb3-b6f7-ad519fbebfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d005cc1-3258-460b-81af-6f4b88a95c77', 'volume_name': 'volume-4d005cc1-3258-460b-81af-6f4b88a95c77', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf29a234-3198-4af3-8b65-7eeb63fdbd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf29a234-3198-4af3-8b65-7eeb63fdbd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1da066c-0ef6-4e60-8c90-9aef4c9c58d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:39:59 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume 4d005cc1-3258-460b-81af-6f4b88a95c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d005cc1-3258-460b-81af-6f4b88a95c77', 'volume_size': 1}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305381479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d005cc1-3258-460b-81af-6f4b88a95c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:39:59Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating volume 4d005cc1-3258-460b-81af-6f4b88a95c77 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:39:59 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:39:59 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:39:59 devstack quobyte-client[84024]: System call of process 101098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:59 devstack quobyte-client[84024]: System call of process 101098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:59 devstack quobyte-client[84024]: System call of process 101098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:59 devstack quobyte-client[84024]: System call of process 101098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:39:59 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=164, name=volume-4d005cc1-3258-460b-81af-6f4b88a95c77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77 1073741824" returned: 0 in 0.929s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:00 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (8474aef8-05ed-47f3-bbd9-84fa1595aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bba0a96-52b6-4871-a2d9-ac1e6a37f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bba0a96-52b6-4871-a2d9-ac1e6a37f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751239897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a61f864-3ebb-4e71-80e8-850587f32fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:00Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3e42df-0e6a-433c-86eb-48009756afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3e42df-0e6a-433c-86eb-48009756afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd65142-f492-4a44-8bac-cda9f432bf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd65142-f492-4a44-8bac-cda9f432bf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a61f864-3ebb-4e71-80e8-850587f32fc7', 'volume_name': 'volume-1a61f864-3ebb-4e71-80e8-850587f32fc7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7966b07e-965d-44f3-a6c0-839721cab498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7966b07e-965d-44f3-a6c0-839721cab498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe649787-2713-4c8a-a9b5-a54bcfbdadf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:01 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume 1a61f864-3ebb-4e71-80e8-850587f32fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a61f864-3ebb-4e71-80e8-850587f32fc7', 'volume_size': 1}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:01 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (10b6bc7a-d96a-4f2a-a7fe-1a79b96e047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73785cba-bfa5-4c18-ad5b-ec64b5936176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:01 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73785cba-bfa5-4c18-ad5b-ec64b5936176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1517502427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8e092c-0e14-456d-8016-79f3537ff7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:00Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df43dd97-e00a-40f5-bee4-661dc7166b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df43dd97-e00a-40f5-bee4-661dc7166b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16f9cf7-4aed-49bd-bdf5-3ca8f8aff8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16f9cf7-4aed-49bd-bdf5-3ca8f8aff8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8e092c-0e14-456d-8016-79f3537ff7a0', 'volume_name': 'volume-2a8e092c-0e14-456d-8016-79f3537ff7a0', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76032834-ebe4-4578-89e5-737fb6ff00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76032834-ebe4-4578-89e5-737fb6ff00bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7f7559-510e-41a7-9c32-c16e7fa0d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume 2a8e092c-0e14-456d-8016-79f3537ff7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8e092c-0e14-456d-8016-79f3537ff7a0', 'volume_size': 1}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (23b793f1-0eb8-49dd-bd3f-c0001176abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb22d978-7744-4f22-8eb4-26d69ca4bfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (85f92568-a042-49de-9399-6012f2dfedb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df51f6db-f240-4735-9e63-f4987d3ca2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77" returned: 0 in 1.493s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb22d978-7744-4f22-8eb4-26d69ca4bfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-476578505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f14bb9d-44aa-4b41-b3f4-814ac618a44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:01Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b5fb76-275e-41e8-a7b3-ff5825356426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b5fb76-275e-41e8-a7b3-ff5825356426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63fe517-20e3-4332-b4be-6cd03473e4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63fe517-20e3-4332-b4be-6cd03473e4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f14bb9d-44aa-4b41-b3f4-814ac618a44a', 'volume_name': 'volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0a9a5e-31c6-43c9-bc01-85cfa6287fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0a9a5e-31c6-43c9-bc01-85cfa6287fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb942f37-2e8a-4958-9e5a-c2f3db67d667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume 3f14bb9d-44aa-4b41-b3f4-814ac618a44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a', 'volume_size': 1}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df51f6db-f240-4735-9e63-f4987d3ca2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021921681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd551036-00b7-4d98-905b-7c5fda37f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:01Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6889000b-1c39-4125-9f87-ed6cd8bedf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6889000b-1c39-4125-9f87-ed6cd8bedf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa34224-30fa-4edf-814d-0b09d5339cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa34224-30fa-4edf-814d-0b09d5339cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd551036-00b7-4d98-905b-7c5fda37f785', 'volume_name': 'volume-cd551036-00b7-4d98-905b-7c5fda37f785', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1f5f05-2cf8-4bff-80a5-b35a095fe9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1f5f05-2cf8-4bff-80a5-b35a095fe9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e493c0-3dad-48b8-a4a3-fb0a5452f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:02 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume cd551036-00b7-4d98-905b-7c5fda37f785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd551036-00b7-4d98-905b-7c5fda37f785', 'volume_size': 1}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] <== create_volume: return (2584ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.595s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751239897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a61f864-3ebb-4e71-80e8-850587f32fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:00Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating volume 1a61f864-3ebb-4e71-80e8-850587f32fc7 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:02 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:02 devstack quobyte-client[84024]: System call of process 101102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:02 devstack quobyte-client[84024]: System call of process 101102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:02 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=165, name=volume-1a61f864-3ebb-4e71-80e8-850587f32fc7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:02 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Flow 'volume_create_manager' (0f01d46e-06bb-466a-9344-cab5fbd3a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:02 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb230881-2e3d-43b1-bce8-363e84ea9e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1da066c-0ef6-4e60-8c90-9aef4c9c58d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d005cc1-3258-460b-81af-6f4b88a95c77', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ac284e-7dcf-4c27-80e9-81e6f1c1ffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb230881-2e3d-43b1-bce8-363e84ea9e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30460b82-8a4c-4ed0-b9ba-38077875e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1db319311fe450293a23840017c2a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:01Z,use_quota=True,user_id='ff8a1952bc27460eb9323b4c05539cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99aa95e-ca02-4348-9f73-5a111eaba055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99aa95e-ca02-4348-9f73-5a111eaba055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75701369-dbb0-4fc3-8e14-42843755f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.image.glance [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Creating Keystone auth plugin from conf {{(pid=84009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7 1073741824" returned: 0 in 1.413s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:03 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume volume-4d005cc1-3258-460b-81af-6f4b88a95c77 (4d005cc1-3258-460b-81af-6f4b88a95c77): created successfully
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ac284e-7dcf-4c27-80e9-81e6f1c1ffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (857ba0cd-b773-4726-9054-ff07acec2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:03 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:04 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7a2af3e2-7473-4b13-9b87-94b4d7a0b05a tempest-CreateVolumesFromSnapshotTest-57012649 None] Created volume successfully.
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7" returned: 0 in 0.639s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] <== create_volume: return (2106ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1517502427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8e092c-0e14-456d-8016-79f3537ff7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:00Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating volume 2a8e092c-0e14-456d-8016-79f3537ff7a0 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:04 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:40:04 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:04 devstack quobyte-client[84024]: System call of process 101108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:04 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=166, name=volume-2a8e092c-0e14-456d-8016-79f3537ff7a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe649787-2713-4c8a-a9b5-a54bcfbdadf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a61f864-3ebb-4e71-80e8-850587f32fc7', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1999af0-1de3-4d51-9195-4f5caafd1681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:05 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume volume-1a61f864-3ebb-4e71-80e8-850587f32fc7 (1a61f864-3ebb-4e71-80e8-850587f32fc7): created successfully
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1999af0-1de3-4d51-9195-4f5caafd1681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (8474aef8-05ed-47f3-bbd9-84fa1595aa93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75701369-dbb0-4fc3-8e14-42843755f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30460b82-8a4c-4ed0-b9ba-38077875e395', 'volume_name': 'volume-30460b82-8a4c-4ed0-b9ba-38077875e395', 'volume_size': 1, 'image_id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04246b4660b741fc58e338893bf98e3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1db319311fe450293a23840017c2a8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '584b536081091a2cfdc9e2659ef4816e27f040577b20e261de73ddd9e5417d5761da3916528e4c5a7c30085ec46544e5cdda572be26234453643ac925b6411cf', 'id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'created_at': datetime.datetime(2025, 9, 23, 13, 39, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 39, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e36aaa0>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76fd77b0-c19d-4cd5-99d9-cc845d855945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76fd77b0-c19d-4cd5-99d9-cc845d855945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b573573b-fba6-4e2b-a4c6-a8eee894a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:05 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Volume 30460b82-8a4c-4ed0-b9ba-38077875e395: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30460b82-8a4c-4ed0-b9ba-38077875e395', 'volume_size': 1, 'image_id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04246b4660b741fc58e338893bf98e3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1db319311fe450293a23840017c2a8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '584b536081091a2cfdc9e2659ef4816e27f040577b20e261de73ddd9e5417d5761da3916528e4c5a7c30085ec46544e5cdda572be26234453643ac925b6411cf', 'id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'created_at': datetime.datetime(2025, 9, 23, 13, 39, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 39, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e36aaa0>}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Cloning 30460b82-8a4c-4ed0-b9ba-38077875e395 from image 42df0ff3-9f0d-4661-b967-d2a5c5ec404d  at location (None, [{'url': 'file:///opt/stack/data/glance/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'metadata': {}}]). {{(pid=84009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0 1073741824" returned: 0 in 1.028s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:05 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-072c1c8c-df8e-4fb8-b6df-8f3ace4131a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created volume successfully.
Sep 23 15:40:05 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0" returned: 0 in 0.461s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] <== create_volume: return (1581ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.879s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-476578505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f14bb9d-44aa-4b41-b3f4-814ac618a44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:01Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating volume 3f14bb9d-44aa-4b41-b3f4-814ac618a44a {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:06 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:06 devstack quobyte-client[84024]: System call of process 101112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:06 devstack quobyte-client[84024]: System call of process 101112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:06 devstack quobyte-client[84024]: System call of process 101112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:06 devstack quobyte-client[84024]: System call of process 101112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:06 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=167, name=volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 23 15:40:06 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Image download 0.00 MB at 0.00 MB/s
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7f7559-510e-41a7-9c32-c16e7fa0d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8e092c-0e14-456d-8016-79f3537ff7a0', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a389ce-8f0f-4e3f-9c72-5acd742d8612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:SELECT=89,cinder:UPDATE=149,cinder:DELETE=16,cinder:INSERT=34 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a 1073741824" returned: 0 in 0.708s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:06 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:07 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume volume-2a8e092c-0e14-456d-8016-79f3537ff7a0 (2a8e092c-0e14-456d-8016-79f3537ff7a0): created successfully
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a389ce-8f0f-4e3f-9c72-5acd742d8612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (10b6bc7a-d96a-4f2a-a7fe-1a79b96e047b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248f234-5991-45b0-9f4a-1f1b30ff1fcc]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=146,cinder:SELECT=97,cinder:DELETE=15,cinder:INSERT=22 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:40:07 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-adb3aafb-79a5-4f74-a665-222822d71b64 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created volume successfully.
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a" returned: 0 in 1.048s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] <== create_volume: return (1842ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:07 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:07 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD
Sep 23 15:40:07 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.846s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021921681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd551036-00b7-4d98-905b-7c5fda37f785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce94bf9536d4a2596403f0de108c7e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:01Z,use_quota=True,user_id='41c8be4a6c814612a2ffd84d0d124460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Creating volume cd551036-00b7-4d98-905b-7c5fda37f785 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:08 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:08 devstack quobyte-client[84024]: System call of process 101118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:08 devstack quobyte-client[84024]: System call of process 101118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:08 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=168, name=volume-cd551036-00b7-4d98-905b-7c5fda37f785, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb942f37-2e8a-4958-9e5a-c2f3db67d667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfbac64-fc1b-48b3-86a8-2827e98e189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:08 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a (3f14bb9d-44aa-4b41-b3f4-814ac618a44a): created successfully
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfbac64-fc1b-48b3-86a8-2827e98e189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (23b793f1-0eb8-49dd-bd3f-c0001176abdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785 1073741824" returned: 0 in 0.732s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:08 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:09 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-b5f4eec0-857a-43a2-9c3a-66fbe02633a9 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created volume successfully.
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785" returned: 0 in 0.443s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] <== create_volume: return (1256ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e493c0-3dad-48b8-a4a3-fb0a5452f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd551036-00b7-4d98-905b-7c5fda37f785', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f715aad9-3ee2-4cdd-85e5-0375018f1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:09 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume volume-cd551036-00b7-4d98-905b-7c5fda37f785 (cd551036-00b7-4d98-905b-7c5fda37f785): created successfully
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f715aad9-3ee2-4cdd-85e5-0375018f1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Flow 'volume_create_manager' (85f92568-a042-49de-9399-6012f2dfedb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:09 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-dc47dd6f-020c-4022-a472-b674f8e54558 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created volume successfully.
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-cd551036-00b7-4d98-905b-7c5fda37f785-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.670s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:10 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-cd551036-00b7-4d98-905b-7c5fda37f785-delete_volume" acquired by "delete_volume" :: waited 0.218s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:11 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-cd551036-00b7-4d98-905b-7c5fda37f785" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-cd551036-00b7-4d98-905b-7c5fda37f785" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb32f84-40bb-4a3d-af7a-b8077356f1e2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:11 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD" returned: 0 in 4.018s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:11 devstack quobyte-client[84024]: System call of process 101127 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785" returned: 0 in 0.609s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:11 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:11 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD
Sep 23 15:40:11 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-cd551036-00b7-4d98-905b-7c5fda37f785" returned: 0 in 0.185s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-cd551036-00b7-4d98-905b-7c5fda37f785" released by "delete_volume" :: held 1.142s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['6f25ccee-6079-4f4c-adf9-308db357e14d', '19527c74-5ee3-4fc8-87aa-471b15ac41c1', 'd29308fc-4cf3-4702-9f0b-d0faeca54d7b', 'a0b90fc9-e6c6-4a7b-9ec9-91f29230f7a1'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:12 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:13 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.150s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:13 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:13 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleted volume successfully.
Sep 23 15:40:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-d7d091ff-665a-4d33-ae1b-7787039f9793 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-cd551036-00b7-4d98-905b-7c5fda37f785-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-3f14bb9d-44aa-4b41-b3f4-814ac618a44a-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:13 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-3f14bb9d-44aa-4b41-b3f4-814ac618a44a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:14 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-3f14bb9d-44aa-4b41-b3f4-814ac618a44a" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-3f14bb9d-44aa-4b41-b3f4-814ac618a44a" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c4ef5-2df1-4acb-bf09-0ff09dba2cda]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:14 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD" returned: 1 in 3.349s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:40:14 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Temporary image 42df0ff3-9f0d-4661-b967-d2a5c5ec404d is fetched for user ff8a1952bc27460eb9323b4c05539cfc. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 23 15:40:14 devstack quobyte-client[84024]: System call of process 101137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:14 devstack quobyte-client[84024]: System call of process 101137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:14 devstack quobyte-client[84024]: System call of process 101137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a" returned: 0 in 0.961s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:15 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec51ea-96da-406f-b634-cccce83d81d5]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:15 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-3f14bb9d-44aa-4b41-b3f4-814ac618a44a" returned: 0 in 0.286s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:15 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-3f14bb9d-44aa-4b41-b3f4-814ac618a44a" released by "delete_volume" :: held 1.631s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:15 devstack sudo[101141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD
Sep 23 15:40:15 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['254c235e-9b6c-43cc-a7c7-9a7be43b97de', '969242df-3a3f-4a52-95a3-6a6c4e59b102', '5c38299a-7e2c-451c-8634-a0c787828395', '23febd61-99df-4b38-9e7b-dd5684661cb7'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.206s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:16 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:16 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleted volume successfully.
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-415697bb-22b1-4d6d-b3fd-6f8594bdccad tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-3f14bb9d-44aa-4b41-b3f4-814ac618a44a-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-2a8e092c-0e14-456d-8016-79f3537ff7a0-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-2a8e092c-0e14-456d-8016-79f3537ff7a0-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:17 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-2a8e092c-0e14-456d-8016-79f3537ff7a0" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-2a8e092c-0e14-456d-8016-79f3537ff7a0" acquired by "delete_volume" :: waited 0.016s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370f0d7-1ac6-4434-9cb0-f1e3e8e3f731]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:17 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:18 devstack quobyte-client[84024]: System call of process 101144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:18 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0" returned: 0 in 1.081s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:19 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root
Sep 23 15:40:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD" returned: 0 in 3.854s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:19 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-2a8e092c-0e14-456d-8016-79f3537ff7a0" returned: 0 in 0.433s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:19 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-2a8e092c-0e14-456d-8016-79f3537ff7a0" released by "delete_volume" :: held 1.837s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['d255e91c-571e-4195-ac9f-8fdd327b35ab', '07b14689-4c44-41df-9e94-baf473c2f80f', '53d2bf84-5655-4b62-8996-68ea476053a7', '9f578ed1-7b5f-4345-9608-729f6d6dbc76'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:20 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD
Sep 23 15:40:20 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.348s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:20 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:20 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleted volume successfully.
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-1a61f864-3ebb-4e71-80e8-850587f32fc7-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-9816d2b9-2d6c-49aa-a52f-2227e58a341b tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-2a8e092c-0e14-456d-8016-79f3537ff7a0-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-1a61f864-3ebb-4e71-80e8-850587f32fc7-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:21 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-1a61f864-3ebb-4e71-80e8-850587f32fc7" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-1a61f864-3ebb-4e71-80e8-850587f32fc7" acquired by "delete_volume" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e27d2e-9ae5-4a35-a460-5e1b4713a37c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:21 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:21 devstack quobyte-client[84024]: System call of process 101154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7" returned: 0 in 0.635s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-1a61f864-3ebb-4e71-80e8-850587f32fc7" returned: 0 in 0.410s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:22 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-1a61f864-3ebb-4e71-80e8-850587f32fc7" released by "delete_volume" :: held 1.391s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD" returned: 1 in 3.583s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30460b82-8a4c-4ed0-b9ba-38077875e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1db319311fe450293a23840017c2a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:01Z,use_quota=True,user_id='ff8a1952bc27460eb9323b4c05539cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Creating volume 30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:22 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:40:22 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:23 devstack quobyte-client[84024]: System call of process 101161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:23 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=169, name=volume-30460b82-8a4c-4ed0-b9ba-38077875e395, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 1073741824" returned: 0 in 0.594s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:23 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:23 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['49928a17-9cc0-4b8a-8aa4-3f6f7bbc9b28', 'e056ce3e-6c15-4f78-a922-95c703136411', '9538065a-9abd-4d05-b28b-459ea75349d0', '34479f65-9d67-4791-a918-2ee13b4c3ca9'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 0 in 0.367s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:24 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] <== create_volume: return (1049ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:24 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Attempting download of 42df0ff3-9f0d-4661-b967-d2a5c5ec404d ((None, [{'url': 'file:///opt/stack/data/glance/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'metadata': {}}])) to volume 30460b82-8a4c-4ed0-b9ba-38077875e395. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 23 15:40:24 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e69a36a-847e-4984-a7a5-1bd9e1f60e63]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:24 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_7l68ruoa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-4d005cc1-3258-460b-81af-6f4b88a95c77-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-4d005cc1-3258-460b-81af-6f4b88a95c77-delete_volume" acquired by "delete_volume" :: waited 0.385s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_7l68ruoa" returned: 0 in 1.327s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:25 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_7l68ruoa {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.864s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:26 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleted volume successfully.
Sep 23 15:40:26 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-4d005cc1-3258-460b-81af-6f4b88a95c77" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-7991500a-b169-4e22-83db-11087530a6d6 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-1a61f864-3ebb-4e71-80e8-850587f32fc7-delete_volume" released by "delete_volume" :: held 5.379s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_7l68ruoa" returned: 1 in 0.862s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_7l68ruoa' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcecdde4-de91-40ba-802e-86c3838bdc94]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-4d005cc1-3258-460b-81af-6f4b88a95c77" acquired by "delete_volume" :: waited 0.104s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ec41d-704f-4fc4-825a-e469226a7700]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:26 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:27 devstack quobyte-client[84024]: System call of process 101171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77" returned: 0 in 0.608s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:27 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-4d005cc1-3258-460b-81af-6f4b88a95c77" returned: 0 in 0.362s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-4d005cc1-3258-460b-81af-6f4b88a95c77" released by "delete_volume" :: held 1.411s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['19226aa8-a033-4706-a883-5611059107bd', '72aa5055-36ba-4c8e-abd7-e8c1b621591d', '129ceab2-ca1f-4c10-bc87-16fa8599f959', 'a278f66b-4c0e-4a4a-b5f8-3206f54313f5'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD" returned: 1 in 0.878s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] 42df0ff3-9f0d-4661-b967-d2a5c5ec404d was raw, converting to raw {{(pid=84009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:28 devstack quobyte-client[84024]: System call of process 101179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:28 devstack quobyte-client[84024]: System call of process 101179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:28 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=169, name=volume-30460b82-8a4c-4ed0-b9ba-38077875e395, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 0 in 0.379s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42df0ff3-9f0d-4661-b967-d2a5c5ec404d_f40dqh2ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:40:28 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Converted 0.00 MB image at 0.00 MB/s
Sep 23 15:40:28 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:29 devstack quobyte-client[84024]: System call of process 101183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-a959b6f3-4a11-4ac2-a79f-0d535819bd1b-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 1G" returned: 0 in 0.855s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:29 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Flow 'volume_create_manager' (a048fe55-6a00-4c39-a208-ce2a669b1ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:29 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff69baa4-a6ee-48e0-9ae8-9d10e9e17988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-a959b6f3-4a11-4ac2-a79f-0d535819bd1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.590s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:30 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-22ff1870-132f-4c43-8ac9-3adf92be4bf8" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff69baa4-a6ee-48e0-9ae8-9d10e9e17988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027888981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5684215e-c2a7-49db-aa0a-f6135599da92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9521aaf3d36242e2864961e2604abef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:29Z,use_quota=True,user_id='8668068bed49401f8366298156c6b035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290235be-8564-473f-b2bb-12e21c10024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290235be-8564-473f-b2bb-12e21c10024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebc266f-b2c6-4634-a15f-6e2cd9ef2fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebc266f-b2c6-4634-a15f-6e2cd9ef2fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5684215e-c2a7-49db-aa0a-f6135599da92', 'volume_name': 'volume-5684215e-c2a7-49db-aa0a-f6135599da92', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69153d24-c073-42c9-a45e-8ae34634e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69153d24-c073-42c9-a45e-8ae34634e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc220a9-8666-4f8e-9e06-d600a099d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:30 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Volume 5684215e-c2a7-49db-aa0a-f6135599da92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5684215e-c2a7-49db-aa0a-f6135599da92', 'volume_size': 1}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f97294ffe80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027888981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5684215e-c2a7-49db-aa0a-f6135599da92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9521aaf3d36242e2864961e2604abef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:29Z,use_quota=True,user_id='8668068bed49401f8366298156c6b035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)}" {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Creating volume 5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:30 devstack cinder-volume[84009]: INFO cinder.volume.drivers.remotefs [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] casted to 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 1073741824 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa90aff-4293-4479-9109-263ce2da5dfa]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:30 devstack quobyte-client[84024]: System call of process 101187 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:30 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=170, name=volume-5684215e-c2a7-49db-aa0a-f6135599da92, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.770s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:30 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleted volume successfully.
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 1073741824" returned: 0 in 0.723s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:30 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-22ff1870-132f-4c43-8ac9-3adf92be4bf8" acquired by "delete_snapshot" :: waited 1.017s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-a959b6f3-4a11-4ac2-a79f-0d535819bd1b" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:31 devstack quobyte-client[84024]: System call of process 101190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:31 devstack quobyte-client[84024]: System call of process 101190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.385s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-8dbabaef-9c63-430d-a49a-3b2e3b0b1f0f tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-4d005cc1-3258-460b-81af-6f4b88a95c77-delete_volume" released by "delete_volume" :: held 5.859s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] <== create_volume: return (1157ms) {'provider_location': '10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'} {{(pid=84009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 0 in 1.026s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-a959b6f3-4a11-4ac2-a79f-0d535819bd1b" acquired by "_delete_snapshot" :: waited 0.260s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleting offline snapshot a959b6f3-4a11-4ac2-a79f-0d535819bd1b of volume 22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] snapshot_file for this snap is: volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be9727d-5564-4002-87df-6bf50715299d]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc220a9-8666-4f8e-9e06-d600a099d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5684215e-c2a7-49db-aa0a-f6135599da92', 'volume_size': 1}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:31 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25962ab5-f78a-478e-b41c-a2f5399ed6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:32 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Volume volume-5684215e-c2a7-49db-aa0a-f6135599da92 (5684215e-c2a7-49db-aa0a-f6135599da92): created successfully
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25962ab5-f78a-478e-b41c-a2f5399ed6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Flow 'volume_create_manager' (a048fe55-6a00-4c39-a208-ce2a669b1ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 1 in 0.639s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Downloaded image 42df0ff3-9f0d-4661-b967-d2a5c5ec404d ((None, [{'url': 'file:///opt/stack/data/glance/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'metadata': {}}])) to volume 30460b82-8a4c-4ed0-b9ba-38077875e395 successfully. {{(pid=84009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Temporary image 42df0ff3-9f0d-4661-b967-d2a5c5ec404d for user ff8a1952bc27460eb9323b4c05539cfc is deleted. {{(pid=84009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.volume_utils [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Marking volume 30460b82-8a4c-4ed0-b9ba-38077875e395 as bootable. {{(pid=84009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 23 15:40:32 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-49b909b6-e13c-4db5-86c0-302d7582e7c8 tempest-SnapshotDependencyTests-2054102219 None] Created volume successfully.
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Copying metadata from image 42df0ff3-9f0d-4661-b967-d2a5c5ec404d to 30460b82-8a4c-4ed0-b9ba-38077875e395. {{(pid=84009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Creating volume glance metadata for volume 30460b82-8a4c-4ed0-b9ba-38077875e395 backed by image 42df0ff3-9f0d-4661-b967-d2a5c5ec404d with: {'image_id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '04246b4660b741fc58e338893bf98e3e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b573573b-fba6-4e2b-a4c6-a8eee894a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30460b82-8a4c-4ed0-b9ba-38077875e395', 'volume_size': 1, 'image_id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04246b4660b741fc58e338893bf98e3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1db319311fe450293a23840017c2a8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '584b536081091a2cfdc9e2659ef4816e27f040577b20e261de73ddd9e5417d5761da3916528e4c5a7c30085ec46544e5cdda572be26234453643ac925b6411cf', 'id': '42df0ff3-9f0d-4661-b967-d2a5c5ec404d', 'created_at': datetime.datetime(2025, 9, 23, 13, 39, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 23, 13, 39, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42df0ff3-9f0d-4661-b967-d2a5c5ec404d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f971e36aaa0>}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c071f73-5f70-4147-9ec7-1631ae04052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b" returned: 0 in 0.697s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:40:32 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Volume volume-30460b82-8a4c-4ed0-b9ba-38077875e395 (30460b82-8a4c-4ed0-b9ba-38077875e395): created successfully
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c071f73-5f70-4147-9ec7-1631ae04052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Flow 'volume_create_manager' (0f01d46e-06bb-466a-9344-cab5fbd3a58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1779277-c2e5-42f1-8585-a3c7b6be7e8a]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:32 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:32 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-a2abf428-aec4-43f2-8309-4580e59361bb tempest-VolumeImageDependencyTests-1883816843 None] Created volume successfully.
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:32 devstack quobyte-client[84024]: System call of process 101205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8" returned: 0 in 0.685s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Acquiring lock "cinder-30460b82-8a4c-4ed0-b9ba-38077875e395-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:33 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Creating offline snapshot b8521cd7-a70b-47f0-b630-d60b58dae203 of volume 5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b" returned: 0 in 0.505s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6583ac1c-a886-47b5-8696-21ba913c4009]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:33 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Lock "cinder-30460b82-8a4c-4ed0-b9ba-38077875e395-delete_volume" acquired by "delete_volume" :: waited 0.569s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8.a959b6f3-4a11-4ac2-a79f-0d535819bd1b" returned: 0 in 0.539s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-a959b6f3-4a11-4ac2-a79f-0d535819bd1b" released by "_delete_snapshot" :: held 2.840s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:34 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Acquiring lock "cinder-quobyte-30460b82-8a4c-4ed0-b9ba-38077875e395" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-22ff1870-132f-4c43-8ac9-3adf92be4bf8" released by "delete_snapshot" :: held 3.256s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.720s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 1G {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:34 devstack quobyte-client[84024]: System call of process 101215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:34 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=171, name=volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Lock "cinder-quobyte-30460b82-8a4c-4ed0-b9ba-38077875e395" acquired by "delete_volume" :: waited 0.527s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 1G" returned: 0 in 0.548s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:34 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5684215e-c2a7-49db-aa0a-f6135599da92 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:35 devstack quobyte-client[84024]: System call of process 101218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:35 devstack quobyte-client[84024]: System call of process 101218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:35 devstack quobyte-client[84024]: System call of process 101218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085a0e5-0ece-4947-9d55-e5d1f748986c]: (4, 'raw') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "qemu-img rebase -u -b volume-5684215e-c2a7-49db-aa0a-f6135599da92 -F qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.492s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:35 devstack quobyte-client[84024]: System call of process 101221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.341s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Setting permissions: /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 -> 1000:1000 {{(pid=84009) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 23 15:40:35 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 0 in 1.023s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.594s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.info" returned: 0 in 0.168s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.info is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.info {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:36 devstack quobyte-client[84024]: System call of process 101225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:36 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['a1b2e27a-c53d-4846-bf35-ce9146e91a3d', 'd41df852-af56-4b0c-b2b2-b4d290bd14bf', '24a9221e-3abe-452d-926e-4a323de30ffd', '4752a47d-d7aa-4438-ba3e-8712ea687f6b'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 1 in 0.781s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395' failed. Not Retrying. {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.info" returned: 0 in 0.316s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.740s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-30460b82-8a4c-4ed0-b9ba-38077875e395" returned: 0 in 0.419s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Lock "cinder-quobyte-30460b82-8a4c-4ed0-b9ba-38077875e395" released by "delete_volume" :: held 2.696s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:37 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-36033de5-3859-4aae-b909-39d51b3a03f5 tempest-SnapshotDependencyTests-2054102219 None] Create snapshot completed successfully
Sep 23 15:40:37 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Delete snapshot completed successfully.
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2bd5e268-49c2-4f75-82bd-8f87aa32b843 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-a959b6f3-4a11-4ac2-a79f-0d535819bd1b-delete_snapshot" released by "delete_snapshot" :: held 7.645s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Created reservations ['f191092f-9af2-439f-9a3b-35a76418a1db', 'dee57fae-6f9f-4fac-8931-5f0bc4bad768', 'aa508877-9048-4c9e-99a1-cdcf7a09e03c', '2208ed8b-d681-4c90-9f51-6401e5f57380'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:37 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.114s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-22ff1870-132f-4c43-8ac9-3adf92be4bf8-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:38 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Deleted volume successfully.
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-22ff1870-132f-4c43-8ac9-3adf92be4bf8-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-ae4ce4f7-7ac7-4cd7-a668-9e7ef57a5c1c tempest-VolumeImageDependencyTests-1883816843 None] Lock "cinder-30460b82-8a4c-4ed0-b9ba-38077875e395-delete_volume" released by "delete_volume" :: held 4.701s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:38 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "cinder-quobyte-22ff1870-132f-4c43-8ac9-3adf92be4bf8" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-22ff1870-132f-4c43-8ac9-3adf92be4bf8" acquired by "delete_volume" :: waited 0.014s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[330ae869-6732-4771-b83b-3134c8c18c3c]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:38 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:39 devstack quobyte-client[84024]: System call of process 101233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:39 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:39 devstack cinder-volume[84009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 23 15:40:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8" returned: 0 in 0.748s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:39 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Flow 'volume_create_manager' (cace3128-2821-4dd5-953b-5c45993b64c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:39 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c8b8e3-7da1-4419-a700-43f7c76849f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c8b8e3-7da1-4419-a700-43f7c76849f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-23T13:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5403a8e5-8fb5-4af8-98e0-c8715b59a4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9521aaf3d36242e2864961e2604abef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-23T13:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8521cd7-a70b-47f0-b630-d60b58dae203,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-23T13:40:39Z,use_quota=True,user_id='8668068bed49401f8366298156c6b035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46beee3f-3bea-47ef-8af7-62dbf2474854),volume_type_id=46beee3f-3bea-47ef-8af7-62dbf2474854)' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a840dc-a0dd-46c9-9ce0-5b488dd5107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a840dc-a0dd-46c9-9ce0-5b488dd5107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c3a631-af79-4b25-a05b-bf28e12aaf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c3a631-af79-4b25-a05b-bf28e12aaf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5403a8e5-8fb5-4af8-98e0-c8715b59a4e5', 'volume_name': 'volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5', 'volume_size': 1, 'snapshot_id': 'b8521cd7-a70b-47f0-b630-d60b58dae203'}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b038d75c-5b56-41a9-b680-c210aa8631a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b038d75c-5b56-41a9-b680-c210aa8631a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2cb70f-a898-4ea1-8b64-5aefc8dd68fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:40 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Volume 5403a8e5-8fb5-4af8-98e0-c8715b59a4e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5', 'volume_size': 1, 'snapshot_id': 'b8521cd7-a70b-47f0-b630-d60b58dae203'}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-22ff1870-132f-4c43-8ac9-3adf92be4bf8" returned: 0 in 0.586s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-quobyte-b8521cd7-a70b-47f0-b630-d60b58dae203-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" by "_create_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-quobyte-22ff1870-132f-4c43-8ac9-3adf92be4bf8" released by "delete_volume" :: held 1.490s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-b8521cd7-a70b-47f0-b630-d60b58dae203-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" acquired by "_create_volume_from_snapshot" :: waited 0.076s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Creating volume 5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 from snapshot b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Selected 10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31 as target Quobyte volume. {{(pid=84009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-quobyte-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" by "_copy_volume_from_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] snapshot: b8521cd7-a70b-47f0-b630-d60b58dae203, volume: 5403a8e5-8fb5-4af8-98e0-c8715b59a4e5,  {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[715217ce-02cf-4ed4-8cbb-8ffa87a42d42]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Created reservations ['0942e085-bdd9-4396-a3d5-0f7c3db34902', '21dc86d2-e7c9-4ffc-9832-04d18331390e', 'e3ff5fcc-684d-40bb-9235-79238ffb73af', 'dbb6761b-64ed-45e3-8ca0-6aa6a7477ee3'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:40 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:41 devstack quobyte-client[84024]: System call of process 101237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:41 devstack quobyte-client[84024]: System call of process 101237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.754s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5684215e-c2a7-49db-aa0a-f6135599da92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Creating direct copy from snapshot {{(pid=84009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.263s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:41 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Deleted volume successfully.
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd407d4d-9da2-4f56-8fd2-88510f8f4ee2]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:41 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-f48ffdf9-b5cc-4dbd-870b-34d8631010c4 tempest-CreateVolumesFromSnapshotTest-57012649 None] Lock "cinder-22ff1870-132f-4c43-8ac9-3adf92be4bf8-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:42 devstack quobyte-client[84024]: System call of process 101241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:42 devstack quobyte-client[84024]: System call of process 101241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:42 devstack quobyte-client[84024]: System call of process 101241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 23 15:40:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.697s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:42 devstack cinder-volume[84009]: DEBUG cinder.utils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 not found in is_blk_device check {{(pid=84009) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 23 15:40:42 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:42 devstack quobyte-client[84024]: The server volume:7a917a49-1a31-4104-aff1-e7a96d1f1be3@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=7a917a49-1a31-4104-aff1-e7a96d1f1be3, inode=173, name=volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.101), requestorAccessMask=0
Sep 23 15:40:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" returned: 0 in 6.440s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:48 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc5457-6cc0-4fce-8f93-36f2877aba27]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:48 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.656s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG cinder.image.image_utils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Image conversion details: src /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 {{(pid=84009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 23 15:40:49 devstack cinder-volume[84009]: INFO cinder.image.image_utils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Converted 1024.00 MB image at 158.06 MB/s
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] File path /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 is being set with permissions: 660 {{(pid=84009) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" returned: 0 in 0.090s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" released by "_copy_volume_from_snapshot" :: held 9.321s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-b8521cd7-a70b-47f0-b630-d60b58dae203-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" released by "_create_volume_from_snapshot" :: held 9.384s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:49 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.474s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2cb70f-a898-4ea1-8b64-5aefc8dd68fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5', 'volume_size': 1, 'snapshot_id': 'b8521cd7-a70b-47f0-b630-d60b58dae203'}' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e3721f-9c94-4d21-b4c8-615ffbdb1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 23 15:40:50 devstack cinder-volume[84009]: INFO cinder.volume.flows.manager.create_volume [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Volume volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 (5403a8e5-8fb5-4af8-98e0-c8715b59a4e5): created successfully
Sep 23 15:40:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e3721f-9c94-4d21-b4c8-615ffbdb1667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84009) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 23 15:40:50 devstack cinder-volume[84009]: DEBUG cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Flow 'volume_create_manager' (cace3128-2821-4dd5-953b-5c45993b64c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84009) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 23 15:40:50 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-5cff7bd7-923b-4676-b130-41e0f4073b09 tempest-SnapshotDependencyTests-2054102219 None] Created volume successfully.
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-b8521cd7-a70b-47f0-b630-d60b58dae203-delete_snapshot" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-b8521cd7-a70b-47f0-b630-d60b58dae203-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:51 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-quobyte-5684215e-c2a7-49db-aa0a-f6135599da92" by "delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5684215e-c2a7-49db-aa0a-f6135599da92" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-quobyte-b8521cd7-a70b-47f0-b630-d60b58dae203" by "_delete_snapshot" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-b8521cd7-a70b-47f0-b630-d60b58dae203" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Deleting offline snapshot b8521cd7-a70b-47f0-b630-d60b58dae203 of volume 5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] snapshot_file for this snap is: volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68a2fd-930f-4ce1-95be-732463571c81]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.409s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.remotefs [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5684215e-c2a7-49db-aa0a-f6135599da92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1050ec-79e1-414e-a363-78972eb78ff9]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:51 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.407s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.228s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92.b8521cd7-a70b-47f0-b630-d60b58dae203" returned: 0 in 0.094s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-b8521cd7-a70b-47f0-b630-d60b58dae203" released by "_delete_snapshot" :: held 1.463s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:52 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5684215e-c2a7-49db-aa0a-f6135599da92" released by "delete_snapshot" :: held 1.484s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Created reservations ['6836f89d-b5d7-4b08-a8d4-ec56b0e62f94', '0fce26df-7fa9-46a5-b2e8-3bc4a7076872', 'b2f3fbcd-865c-4a32-a252-781d89f31522', '0d0257a8-15fb-48d3-b739-5b00df39794c'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:53 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Delete snapshot completed successfully.
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-328fb881-2709-419f-aebf-4adf3f7a9cbc tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-b8521cd7-a70b-47f0-b630-d60b58dae203-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-5684215e-c2a7-49db-aa0a-f6135599da92-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-5684215e-c2a7-49db-aa0a-f6135599da92-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:53 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-quobyte-5684215e-c2a7-49db-aa0a-f6135599da92" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5684215e-c2a7-49db-aa0a-f6135599da92" acquired by "delete_volume" :: waited 0.012s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71f9755-b0cf-4413-8aa7-388232958881]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:53 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.417s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5684215e-c2a7-49db-aa0a-f6135599da92" returned: 0 in 0.098s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5684215e-c2a7-49db-aa0a-f6135599da92" released by "delete_volume" :: held 0.717s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Created reservations ['26a72e4e-c116-491d-bdd2-56b10bcf1301', 'e294f2c8-c57c-4b53-a179-792bd9f1a94f', 'd7ebcfed-da1f-4dd1-8e64-8083fda6a863', '7dc57b6f-137a-4e65-b41b-9cedb0dbdd63'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.096s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:54 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:54 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Deleted volume successfully.
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-2e37edc1-3a61-4a39-9cff-a42640b2c836 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-5684215e-c2a7-49db-aa0a-f6135599da92-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5-delete_volume" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:55 devstack cinder-volume[84009]: WARNING cinder.volume.volume_utils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "cinder-quobyte-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" by "delete_volume" {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" acquired by "delete_volume" :: waited 0.019s {{(pid=84009) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab4fbc5-abbe-4033-8fab-159f9cafc857]: (4, 'qcow2') {{(pid=85024) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 23 15:40:55 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" returned: 0 in 0.395s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5 {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:56 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] CMD "rm -f /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c/volume-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" returned: 0 in 0.095s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:56 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-quobyte-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5" released by "delete_volume" :: held 0.686s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:40:56 devstack cinder-volume[84009]: DEBUG cinder.quota [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Created reservations ['3b09fc8b-ec05-4174-94a9-c679405dc6d5', '6b6dc694-372f-44be-b113-3afebacbc996', 'bcf7ffba-4259-4e10-aeac-754db62e6988', '5ca1ec90-9e68-41b9-ac9d-4b318feab14d'] {{(pid=84009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.088s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 23 15:40:57 devstack cinder-volume[84009]: INFO cinder.volume.manager [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Deleted volume successfully.
Sep 23 15:40:57 devstack cinder-volume[84009]: DEBUG cinder.coordination [None req-6c6b8c05-c8f3-495a-bba3-99f323170704 tempest-SnapshotDependencyTests-2054102219 None] Lock "cinder-5403a8e5-8fb5-4af8-98e0-c8715b59a4e5-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=84009) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 23 15:41:07 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:DELETE=10,cinder:UPDATE=104,cinder:SELECT=64,cinder:INSERT=37 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:41:07 devstack cinder-volume[84009]: DEBUG dbcounter [-] [84009] Writing DB stats cinder:UPDATE=84,cinder:SELECT=65,cinder:INSERT=16,cinder:DELETE=6 {{(pid=84009) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG oslo_service.periodic_task [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84009) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31': None} {{(pid=84009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG cinder.volume.drivers.quobyte [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Available shares ['10.10.41.181/cinder-vol-ab33b7be-a482-4b0d-af76-1e9f48f4eb31'] {{(pid=84009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.lockutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84009) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 23 15:41:09 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 23 15:41:10 devstack cinder-volume[84009]: DEBUG oslo_concurrency.processutils [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/7abf96001d1750758ea0240415345b6c" returned: 0 in 0.107s {{(pid=84009) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 23 15:41:10 devstack cinder-volume[84009]: DEBUG cinder.manager [None req-db5fbdc5-52a7-4c78-8514-c0b1f09bb27c None None] Notifying Schedulers of capabilities ... {{(pid=84009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}